Isleepinahammocks idea would probably work. But rotation and translation would not. Thats something you can easily take care of in your training data, by reusing the same training data in multiple random positions and random angles.