This paper presents the author's view on the main challenges for autonomous operation in surface mining environment. A brief overview of the mine operation is presented showing the number of components that needs to interact in a safe, robust and efficient manner. Successful implementation of autonomous systems in field robotic applications are presented with a discussion of the fundamental problems that needs to be addressed to have this technology accepted in mining operations.