Complete Sentences

 I think I have mentioned this before but it is still on my mind whenever I commit grammar infractions.  I do this on purpose.  I am fully aware of and understand the difference between complete and incomplete sentences.  I understand and recall my elementary school grammar lessons.  My issue is that in writing, there are times when I want to use incomplete sentences.  I often want to add an incomplete sentence as an extension or added reflection to a previous statement that I have just made.  I want these added reflections to be separate from their preceding statements, but I feel that their added emphasis and meaning is expressed better without the grammatical burden of having to be complete sentences.  Does grammar have to be such a stickler?  Can’t occasional use of incomplete sentences be an acceptable form and style of writing??  Rules are meant to be broken aren’t they?  How can creative expression in writing exist if it is constrained to formal rules of grammar??  Creativity in all forms is about pushing boundaries and doing things in different and novel ways.  Is it not?