Devices are added to the Cloud Connector Group when they are first activated (i.e. the devices are in Live/Enabled state). Before that, the device will not be listed in the group.
If you are using the APIs, it could be because you have removed the device from a Group and/or moved it to a different group. You can check using the API which devices belong to a Group and move it back to the desired Group.