To add an inbetween key in the graph editor which doesn’t affect the shape of the existing curve, don’t use the ‘+’ icon.  

Hold down ‘i’ with your curve selected, and middle click where you want to insert the key.