Programatically adding External users with Permission

First of all I'd like to mention I am developing for SharePoint Online using Client Object Model, 

What I am trying to achieve is to apply site permission to an external user programatically, I have it working for internal users but whenever I try adding an External user it doesn't work, is this even possible? I personally have my doubts that we can do what I am trying to achieve.