Learning Robotics Through Coding Programming Advanced Behaviors for Robots

How To Program A Robot: Beginners Guide

Robots have been among us for a good two or three decades now. Nowadays, robots are more ingrained in our culture than ever before. Most robotic machines are in use in various assembly lines or perform intense physical operations in mines or industrial facilities across the world.

There are also home robots where engineers are programming robots to clean your house or perform other housekeeping duties. As of now, robotics programming is able to produce robots that perform relatively simple daily tasks. There are specific challenges in programming your own robot because a fully operational robot for home or office use requires six degrees of freedom (6DoF) to operate in the real worlds three-dimensional space.

With that being said, your journey in learning about robotics programming should start with the 6DoF. This includes robotic capabilities to move forward and backward, up and down, turn left and right. It should also be able to rotate about three perpendicular axes, which are called pitch, yaw, and roll.

It is not that easy to learn how to program a robot that is able to perform all these moves and operate relying only on information coming from a limited number of sensors. Our robotics for beginners guide will give you the basics you should start with when programing your first robot.

Introduction to Robotics: How to Program a Robot

Lets start our robotics tutorial with the statement that your understanding of a robot as a smart machine is wrong. First of all, a robot might well be just a piece of software that has no physical presence in the real world. Java robotics programming is used to make foreign exchange trading robots that operate on different hardware such as computers, tablets, and smartphones. None of these Forex-trading robots have a physical body; these are just algorithms programmed to trade currencies in accordance with the set rules.

We also have autonomous robots and robots that need only limited or no autonomy to operate. Coding for robotics is different when you have an autonomous machine and another that performs a limited number of repetitive operations in an industrial environment. A good example of this is the robots that weld car components in an assembly line.

The problem of robotic programming depends on what you need to design. An autonomous robot will probably require certain machine learning capabilities or some degree of artificial intelligence, so you might have to use a different programming language compared to a robot programmed to perform a select number of functions.

Coding Languages for Robotics Programming

There are ongoing debates on how to program a robot and which programming language is the best one for robotics programming. Actually, it always depends on your ultimate goal and any language could fit the bill if you know what you want and how to achieve it.

There is a broad consensus that robotics programming should rely mostly on languages such as C/C++ and Python. C and C++ are the languages with which robotics beginners start, but you cannot just stick to these two languages if you want to develop as a good robot computer scientist.

Coding for robotics involves also numerous industrial robot languages by manufacturers of robotic equipment. Learning Pascal is a good starting point. This software deals with some of these proprietary robotics programming languages. But you still need to learn each of them in detail.

MATLAB is another tool you need to master when you study how to program a robot. Programming robots involves lots of mathematics and data analysis. You need the proper means to process data and get reliable results from your hardware and software sensors if you are to have your robot working as intended.

Once you have some knowledge in programming with C/C++, Python, Java, or another language used in robotics, the time has come to program your first robot. We suggest starting with a software robot as it is far easier to write a program code that performs functions not related to the control of a physical device.

Robotics Programming for Beginners

Image recognition and more recently natural language processing are among the core problems robotics scientists must solve in order to design robots that mimic human behavior. So, lets start our robotics programming tutorial with a simple algorithm to secure your home or office by introducing a robot that uses a connected camera to recognize faces.

How do you program such a software robot? All it takes are the following steps:

1. Install a motion sensor at your front door and connect it to a camera.
2. Instruct the motion sensor to activate the camera once someone is at the door.
3. The camera takes an image of the persons face as input.
4. Scan the image for a specific set of features.
5. Compare these features to a library of known faces.
6. If you find a match, instruct the door to open.
7. If there is no match, continue by taking another sort of action.

It does not matter what programming language you will use to program the software to perform this set of commands. Your first robotics programming algorithm will execute the above steps over and over again once the triggering condition is in place (i.e. someone activates the motion sensor at your front door).

This a simple robot that uses programmable hardware. In this case, the hardware includes a motion sensor, a camera, and a computer that will hold your database of known faces resides. The computer is especially needed to perform the very simple action of unlocking a door.

You can write this program in only 100 lines of code. However, this is only possible if you have ready-made software models that handle the facial recognition process. In truth, the skills to write the very facial recognition programming code are what make a software programmer an advanced coder.

Further Discussion on How to Program a Robot

Now that you have recognized your first visitor and let them in, you may decide to place a robotic arm that takes your visitors coats and place them in a wardrobe.

What you need is to control a dynamic system that involves sensors and a robotic arm. What the arm should do is to recognize the coat in place, get it, and place it somewhere. How you do that? Your robotic arm programming will involve the following steps:

1. Application of control signals.
2. Results measuring.
3. Generation of new control signals calculated to bring your arm closer to our goal.

The process involves lots of mathematics and a constant flow of reliable data if you want your robot to get the coat and store it for your guest. It is about processing sensor data in real-time and then applying the fundamental logical operators if and then to control your robotic arm. If we simplify it further, you perform programming like if too left, then move right and if too low, then move up. That is how coding for robotics works.

Final Thoughts on How to Program a Robot

Robotics is developing very fast. Keeping up with the latest developments in the field of programmable machines requires efforts that go beyond the familiarity with one or another language that is suitable for programming robots.

If you really want to master how to program a robot, you need to understand a robots requirements and capabilities at both hardware and software level. Thankfully, a number of platforms enable robotics programming for beginners. This is done by eliminating much of the difficulties pertaining to knowing how hardware operates. It can also be done by programming systems at the level of zeroes and ones.

What you basically need in robotics for beginners is to have programmable hardware or pre-programmed software modules. Afterward, you can program to perform certain operations. In any case, you will need to learn one or more programming languages such as C/C++, Python, LISP, or Java to make even the simplest software/hardware robot work. When you advance further, it is advisable to get acquainted with tools like MATLAB. This ensures you are in full command and control of your robots.

An Introductory Robot Programming Tutorial

Editor's note: On October 16th, 2018, this article was overhauled to work with the latest technologies.

Lets face it, robots are cool. Theyre also going to run the world some day, and hopefully, at that time they will take pity on their poor soft fleshy creators (a.k.a. robotics developers) and help us build a space utopia filled with plenty. Im joking of course, but only sort of.

In my ambition to have some small influence over the matter, I took a course in autonomous robot control theory last year, which culminated in my building a Python-based robotic simulator that allowed me to practice control theory on a simple, mobile, programmable robot.

In this article, Im going to show how to use a Python robot framework to develop control software, describe the control scheme I developed for my simulated robot, illustrate how it interacts with its environment and achieves its goals, and discuss some of the fundamental challenges of robotics programming that I encountered along the way.

In order to follow this tutorial on robotics programming for beginners, you should have a basic knowledge of two things:

• Mathematicswe will use some trigonometric functions and vectors
• Pythonsince Python is among the more popular basic robot programming languageswe will make use of basic Python libraries and functions

The snippets of code shown here are just a part of the entire simulator, which relies on classes and interfaces, so in order to read the code directly, you may need some experience in Python and object oriented programming.

Finally, optional topics that will help you to better follow this tutorial are knowing what a state machine is and how range sensors and encoders work.

The Challenge of the Programmable Robot: Perception vs. Reality, and the Fragility of Control

The fundamental challenge of all robotics is this: It is impossible to ever know the true state of the environment. Robot control software can only guess the state of the real world based on measurements returned by its sensors. It can only attempt to change the state of the real world through the generation of control signals.

Robot control software can only guess the state of the real world based on measurements returned by its sensors.

Thus, one of the first steps in control design is to come up with an abstraction of the real world, known as a model, with which to interpret our sensor readings and make decisions. As long as the real world behaves according to the assumptions of the model, we can make good guesses and exert control. As soon as the real world deviates from these assumptions, however, we will no longer be able to make good guesses, and control will be lost. Often, once control is lost, it can never be regained. (Unless some benevolent outside force restores it.)

This is one of the key reasons that robotics programming is so difficult. We often see videos of the latest research robot in the lab, performing fantastic feats of dexterity, navigation, or teamwork, and we are tempted to ask, Why isnt this used in the real world? Well, next time you see such a video, take a look at how highly-controlled the lab environment is. In most cases, these robots are only able to perform these impressive tasks as long as the environmental conditions remain within the narrow confines of its internal model. Thus, one key to the advancement of robotics is the development of more complex, flexible, and robust modelsand said advancement is subject to the limits of the available computational resources.

One key to the advancement of robotics is the development of more complex, flexible, and robust models.

[Side Note: Philosophers and psychologists alike would note that living creatures also suffer from dependence on their own internal perception of what their senses are telling them. Many advances in robotics come from observing living creatures and seeing how they react to unexpected stimuli. Think about it. What is your internal model of the world? It is different from that of an ant, and that of a fish? (Hopefully.) However, like the ant and the fish, it is likely to oversimplify some realities of the world. When your assumptions about the world are not correct, it can put you at risk of losing control of things. Sometimes we call this danger. The same way our little robot struggles to survive against the unknown universe, so do we all. This is a powerful insight for roboticists.]

The Programmable Robot Simulator

The simulator I built is written in Python and very cleverly dubbed Sobot Rimulator. You can find v1.0.0 on GitHub. It does not have a lot of bells and whistles but it is built to do one thing very well: provide an accurate simulation of a mobile robot and give an aspiring roboticist a simple framework for practicing robot software programming. While it is always better to have a real robot to play with, a good Python robot simulator is much more accessible and is a great place to start.

In real-world robots, the software that generates the control signals (the controller) is required to run at a very high speed and make complex computations. This affects the choice of which robot programming languages are best to use: Usually, C++ is used for these kinds of scenarios, but in simpler robotics applications, Python is a very good compromise between execution speed and ease of development and testing.

The software I wrote simulates a real-life research robot called the Khepera but it can be adapted to a range of mobile robots with different dimensions and sensors. Since I tried to program the simulator as similar as possible to the real robots capabilities, the control logic can be loaded into a real Khepera robot with minimal refactoring, and it will perform the same as the simulated robot. The specific features implemented refer to the Khepera III, but they can be easily adapted to the new Khepera IV.

In other words, programming a simulated robot is analogous to programming a real robot. This is critical if the simulator is to be of any use to develop and evaluate different control software approaches.

In this tutorial, I will be describing the robot control software architecture that comes with v1.0.0 of Sobot Rimulator, and providing snippets from the Python source (with slight modifications for clarity). However, I encourage you to dive into the source and mess around. The simulator has been forked and used to control different mobile robots, including a Roomba2 from iRobot. Likewise, please feel free to fork the project and improve it.

The control logic of the robot is constrained to these Python classes/files:

• models/supervisor.pythis class is responsible for the interaction between the simulated world around the robot and the robot itself. It evolves our robot state machine and triggers the controllers for computing the desired behavior.
• models/supervisor_state_machine.pythis class represents the different states in which the robot can be, depending on its interpretation of the sensors.
• The files in the models/controllers directorythese classes implement different behaviors of the robot given a known state of the environment. In particular, a specific controller is selected depending on the state machine.

The Goal

Robots, like people, need a purpose in life. The goal of our software controlling this robot will be very simple: It will attempt to make its way to a predetermined goal point. This is usually the basic feature that any mobile robot should have, from autonomous cars to robotic vacuum cleaners. The coordinates of the goal are programmed into the control software before the robot is activated but could be generated from an additional Python application that oversees the robot movements. For example, think of it driving through multiple waypoints.

However, to complicate matters, the environment of the robot may be strewn with obstacles. The robot MAY NOT collide with an obstacle on its way to the goal. Therefore, if the robot encounters an obstacle, it will have to find its way around so that it can continue on its way to the goal.

The Programmable Robot

Every robot comes with different capabilities and control concerns. Lets get familiar with our simulated programmable robot.

The first thing to note is that, in this guide, our robot will be an autonomous mobile robot. This means that it will move around in space freely and that it will do so under its own control. This is in contrast to, say, a remote-control robot (which is not autonomous) or a factory robot arm (which is not mobile). Our robot must figure out for itself how to achieve its goals and survive in its environment. This proves to be a surprisingly difficult challenge for novice robotics programmers.

Control Inputs: Sensors

There are many different ways a robot may be equipped to monitor its environment. These can include anything from proximity sensors, light sensors, bumpers, cameras, and so forth. In addition, robots may communicate with external sensors that give them information that they themselves cannot directly observe.

Our reference robot is equipped with nine infrared sensorsthe newer model has eight infrared and five ultrasonic proximity sensorsarranged in a skirt in every direction. There are more sensors facing the front of the robot than the back because it is usually more important for the robot to know what is in front of it than what is behind it.

In addition to the proximity sensors, the robot has a pair of wheel tickers that track wheel movement. These allow you to track how many rotations each wheel makes, with one full forward turn of a wheel being 2,765 ticks. Turns in the opposite direction count backward, decreasing the tick count instead of increasing it. You dont have to worry about specific numbers in this tutorial because the software we will write uses the traveled distance expressed in meters. Later I will show you how to compute it from ticks with an easy Python function.

Control Outputs: Mobility

Some robots move around on legs. Some roll like a ball. Some even slither like a snake.

Our robot is a differential drive robot, meaning that it rolls around on two wheels. When both wheels turn at the same speed, the robot moves in a straight line. When the wheels move at different speeds, the robot turns. Thus, controlling the movement of this robot comes down to properly controlling the rates at which each of these two wheels turn.

API

In Sobot Rimulator, the separation between the robot computer and the (simulated) physical world is embodied by the file robot_supervisor_interface.py, which defines the entire API for interacting with the real robot sensors and motors:

• read_proximity_sensors() returns an array of nine values in the sensors native format
• read_wheel_encoders() returns an array of two values indicating total ticks since the start
• set_wheel_drive_rates( v_l, v_r ) takes two values (in radians-per-second) and sets the left and right speed of the wheels to those two values

This interface internally uses a robot object that provides the data from sensors and the possibility to move motors or wheels. If you want to create a different robot, you simply have to provide a different Python robot class that can be used by the same interface, and the rest of the code (controllers, supervisor, and simulator) will work out of the box!

The Simulator

As you would use a real robot in the real world without paying too much attention to the laws of physics involved, you can ignore how the robot is simulated and just skip directly to how the controller software is programmed, since it will be almost the same between the real world and a simulation. But if you are curious, I will briefly introduce it here.

The file world.py is a Python class that represents the simulated world, with robots and obstacles inside. The step function inside this class takes care of evolving our simple world by:

• Applying physics rules to the robots movements
• Considering collisions with obstacles
• Providing new values for the robot sensors

In the end, it calls the robot supervisors responsible for executing the robot brain software.

The step function is executed in a loop so that robot.step_motion() moves the robot using the wheel speed computed by the supervisor in the previous simulation step.

# step the simulation through one time intervaldef step( self ):dt = self.dt# step all the robotsfor robot in self.robots:# step robot motionrobot.step_motion( dt )# apply physics interactionsself.physics.apply_physics()# NOTE: The supervisors must run last to ensure they are observing the "current" world# step all of the supervisorsfor supervisor in self.supervisors:supervisor.step( dt )# increment world timeself.world_time += dt

The apply_physics() function internally updates the values of the robot proximity sensors so that the supervisor will be able to estimate the environment at the current simulation step. The same concepts apply to the encoders.

A Simple Model

First, our robot will have a very simple model. It will make many assumptions about the world. Some of the important ones include:

• The terrain is always flat and even
• Obstacles are never round
• The wheels never slip
• Nothing is ever going to push the robot around
• The sensors never fail or give false readings
• The wheels always turn when they are told to

Although most of these assumptions are reasonable inside a house-like environment, round obstacles could be present. Our obstacle avoidance software has a simple implementation and follows the border of obstacles in order to go around them. We will hint readers on how to improve the control framework of our robot with an additional check to avoid circular obstacles.

The Control Loop

We will now enter into the core of our control software and explain the behaviors that we want to program inside the robot. Additional behaviors can be added to this framework, and you should try your own ideas after you finish reading! Behavior-based robotics software was proposed more than 20 years ago and its still a powerful tool for mobile robotics. As an example, in 2007 a set of behaviors was used in the DARPA Urban Challengethe first competition for autonomous driving cars!

A robot is a dynamic system. The state of the robot, the readings of its sensors, and the effects of its control signals are in constant flux. Controlling the way events play out involves the following three steps:

1. Apply control signals.
2. Measure the results.
3. Generate new control signals calculated to bring us closer to our goal.

These steps are repeated over and over until we have achieved our goal. The more times we can do this per second, the finer control we will have over the system. The Sobot Rimulator robot repeats these steps 20 times per second (20 Hz), but many robots must do this thousands or millions of times per second in order to have adequate control. Remember our previous introduction about different robot programming languages for different robotics systems and speed requirements.

In general, each time our robot takes measurements with its sensors, it uses these measurements to update its internal estimate of the state of the worldfor example, the distance from its goal. It compares this state to a reference value of what it wants the state to be (for the distance, it wants it to be zero), and calculates the error between the desired state and the actual state. Once this information is known, generating new control signals can be reduced to a problem of minimizing the error which will eventually move the robot towards the goal.

A Nifty Trick: Simplifying the Model

To control the robot we want to program, we have to send a signal to the left wheel telling it how fast to turn, and a separate signal to the right wheel telling it how fast to turn. Lets call these signals vL and vR. However, constantly thinking in terms of vL and vR is very cumbersome. Instead of asking, How fast do we want the left wheel to turn, and how fast do we want the right wheel to turn? it is more natural to ask, How fast do we want the robot to move forward, and how fast do we want it to turn, or change its heading? Lets call these parameters velocity v and angular (rotational) velocity (read omega). It turns out we can base our entire model on v and instead of vL and vR, and only once we have determined how we want our programmed robot to move, mathematically transform these two values into the vL and vR we need to actually control the robot wheels. This is known as a unicycle model of control.

Here is the Python code that implements the final transformation in supervisor.py. Note that if is 0, both wheels will turn at the same speed:

# generate and send the correct commands to the robotdef _send_robot_commands( self ):  # ...  v_l, v_r = self._uni_to_diff( v, omega )  self.robot.set_wheel_drive_rates( v_l, v_r )def _uni_to_diff( self, v, omega ):  # v = translational velocity (m/s)  # omega = angular velocity (rad/s)  R = self.robot_wheel_radius  L = self.robot_wheel_base_length  v_l = ( (2.0 * v) - (omega*L) ) / (2.0 * R)  v_r = ( (2.0 * v) + (omega*L) ) / (2.0 * R)  return v_l, v_r

Estimating State: Robot, Know Thyself

Using its sensors, the robot must try to estimate the state of the environment as well as its own state. These estimates will never be perfect, but they must be fairly good because the robot will be basing all of its decisions on these estimations. Using its proximity sensors and wheel tickers alone, it must try to guess the following:

• The direction to obstacles
• The distance from obstacles
• The position of the robot
• The heading of the robot

The first two properties are determined by the proximity sensor readings and are fairly straightforward. The API function read_proximity_sensors() returns an array of nine values, one for each sensor. We know ahead of time that the seventh reading, for example, corresponds to the sensor that points 75 degrees to the right of the robot.

Thus, if this value shows a reading corresponding to 0.1 meters distance, we know that there is an obstacle 0.1 meters away, 75 degrees to the left. If there is no obstacle, the sensor will return a reading of its maximum range of 0.2 meters. Thus, if we read 0.2 meters on sensor seven, we will assume that there is actually no obstacle in that direction.

Because of the way the infrared sensors work (measuring infrared reflection), the numbers they return are a non-linear transformation of the actual distance detected. Thus, the Python function for determining the distance indicated must convert these readings into meters. This is done in supervisor.py as follows:

# update the distances indicated by the proximity sensorsdef _update_proximity_sensor_distances( self ):    self.proximity_sensor_distances = [ 0.02-( log(readval/3960.0) )/30.0 for        readval in self.robot.read_proximity_sensors() ]

Again, we have a specific sensor model in this Python robot framework, while in the real world, sensors come with accompanying software that should provide similar conversion functions from non-linear values to meters.

Determining the position and heading of the robot (together known as the pose in robotics programming) is somewhat more challenging. Our robot uses odometry to estimate its pose. This is where the wheel tickers come in. By measuring how much each wheel has turned since the last iteration of the control loop, it is possible to get a good estimate of how the robots pose has changedbut only if the change is small.

This is one reason it is important to iterate the control loop very frequently in a real-world robot, where the motors moving the wheels may not be perfect. If we waited too long to measure the wheel tickers, both wheels could have done quite a lot, and it will be impossible to estimate where we have ended up.

Given our current software simulator, we can afford to run the odometry computation at 20 Hzthe same frequency as the controllers. But it could be a good idea to have a separate Python thread running faster to catch smaller movements of the tickers.

Below is the full odometry function in supervisor.py that updates the robot pose estimation. Note that the robots pose is composed of the coordinates x and y, and the heading theta, which is measured in radians from the positive X-axis. Positive x is to the east and positive y is to the north. Thus a heading of 0 indicates that the robot is facing directly east. The robot always assumes its initial pose is (0, 0), 0.

# update the estimated position of the robot using it's wheel encoder readingsdef _update_odometry( self ):  R = self.robot_wheel_radius  N = float( self.wheel_encoder_ticks_per_revolution )    # read the wheel encoder values  ticks_left, ticks_right = self.robot.read_wheel_encoders()    # get the difference in ticks since the last iteration  d_ticks_left = ticks_left - self.prev_ticks_left  d_ticks_right = ticks_right - self.prev_ticks_right    # estimate the wheel movements  d_left_wheel = 2*pi*R*( d_ticks_left / N )  d_right_wheel = 2*pi*R*( d_ticks_right / N )  d_center = 0.5 * ( d_left_wheel + d_right_wheel )    # calculate the new pose  prev_x, prev_y, prev_theta = self.estimated_pose.scalar_unpack()  new_x = prev_x + ( d_center * cos( prev_theta ) )  new_y = prev_y + ( d_center * sin( prev_theta ) )  new_theta = prev_theta + ( ( d_right_wheel - d_left_wheel ) / self.robot_wheel_base_length )    # update the pose estimate with the new values  self.estimated_pose.scalar_update( new_x, new_y, new_theta )    # save the current tick count for the next iteration  self.prev_ticks_left = ticks_left  self.prev_ticks_right = ticks_right

Now that our robot is able to generate a good estimate of the real world, lets use this information to achieve our goals.

Python Robot Programming Methods: Go-to-Goal Behavior

The supreme purpose in our little robots existence in this programming tutorial is to get to the goal point. So how do we make the wheels turn to get it there? Lets start by simplifying our worldview a little and assume there are no obstacles in the way.

This then becomes a simple task and can be easily programmed in Python. If we go forward while facing the goal, we will get there. Thanks to our odometry, we know what our current coordinates and heading are. We also know what the coordinates of the goal are because they were pre-programmed. Therefore, using a little linear algebra, we can determine the vector from our location to the goal, as in go_to_goal_controller.py:

# return a go-to-goal heading vector in the robot's reference framedef calculate_gtg_heading_vector( self ):  # get the inverse of the robot's pose  robot_inv_pos, robot_inv_theta = self.supervisor.estimated_pose().inverse().vector_unpack()    # calculate the goal vector in the robot's reference frame  goal = self.supervisor.goal()  goal = linalg.rotate_and_translate_vector( goal, robot_inv_theta, robot_inv_pos )    return goal

Note that we are getting the vector to the goal in the robots reference frame, and NOT in world coordinates. If the goal is on the X-axis in the robots reference frame, that means it is directly in front of the robot. Thus, the angle of this vector from the X-axis is the difference between our heading and the heading we want to be on. In other words, it is the error between our current state and what we want our current state to be. We, therefore, want to adjust our turning rate so that the angle between our heading and the goal will change towards 0. We want to minimize the error:

# calculate the error termstheta_d = atan2( self.gtg_heading_vector[1], self.gtg_heading_vector[0] )# calculate angular velocityomega = self.kP * theta_d

self.kP in the above snippet of the controller Python implementation is a control gain. It is a coefficient which determines how fast we turn in proportion to how far away from the goal we are facing. If the error in our heading is 0, then the turning rate is also 0. In the real Python function inside the file go_to_goal_controller.py, you will see more similar gains, since we used a PID controller instead of a simple proportional coefficient.

Now that we have our angular velocity , how do we determine our forward velocity v? A good general rule of thumb is one you probably know instinctively: If we are not making a turn, we can go forward at full speed, and then the faster we are turning, the more we should slow down. This generally helps us keep our system stable and acting within the bounds of our model. Thus, v is a function of . In go_to_goal_controller.py the equation is:

# calculate translational velocity# velocity is v_max when omega is 0,# drops rapidly to zero as |omega| risesv = self.supervisor.v_max() / ( abs( omega ) + 1 )**0.5

A suggestion to elaborate on this formula is to consider that we usually slow down when near the goal in order to reach it with zero speed. How would this formula change? It has to include somehow a replacement of v_max() with something proportional to the distance.OK, we have almost completed a single control loop. The only thing left to do is transform these two unicycle-model parameters into differential wheel speeds, and send the signals to the wheels. Heres an example of the robots trajectory under the go-to-goal controller, with no obstacles:

As we can see, the vector to the goal is an effective reference for us to base our control calculations on. It is an internal representation of where we want to go. As we will see, the only major difference between go-to-goal and other behaviors is that sometimes going towards the goal is a bad idea, so we must calculate a different reference vector.

Python Robot Programming Methods: Avoid-Obstacles Behavior

Going towards the goal when theres an obstacle in that direction is a case in point. Instead of running headlong into things in our way, lets try to program a control law that makes the robot avoid them.

To simplify the scenario, lets now forget the goal point completely and just make the following our objective: When there are no obstacles in front of us, move forward. When an obstacle is encountered, turn away from it until it is no longer in front of us.

Accordingly, when there is no obstacle in front of us, we want our reference vector to simply point forward. Then will be zero and v will be maximum speed. However, as soon as we detect an obstacle with our proximity sensors, we want the reference vector to point in whatever direction is away from the obstacle. This will cause to shoot up to turn us away from the obstacle, and cause v to drop to make sure we dont accidentally run into the obstacle in the process.

A neat way to generate our desired reference vector is by turning our nine proximity readings into vectors, and taking a weighted sum. When there are no obstacles detected, the vectors will sum symmetrically, resulting in a reference vector that points straight ahead as desired. But if a sensor on, say, the right side picks up an obstacle, it will contribute a smaller vector to the sum, and the result will be a reference vector that is shifted towards the left.

For a general robot with a different placement of sensors, the same idea can be applied but may require changes in the weights and/or additional care when sensors are symmetrical in front and in the rear of the robot, as the weighted sum could become zero.

Here is the code that does this in avoid_obstacles_controller.py:

# sensor gains (weights)self.sensor_gains = [ 1.0+( (0.4*abs(p.theta)) / pi )                      for p in supervisor.proximity_sensor_placements() ]# ...# return an obstacle avoidance vector in the robot's reference frame# also returns vectors to detected obstacles in the robot's reference framedef calculate_ao_heading_vector( self ):  # initialize vector  obstacle_vectors = [ [ 0.0, 0.0 ] ] * len( self.proximity_sensor_placements )  ao_heading_vector = [ 0.0, 0.0 ]                 # get the distances indicated by the robot's sensor readings  sensor_distances = self.supervisor.proximity_sensor_distances()    # calculate the position of detected obstacles and find an avoidance vector  robot_pos, robot_theta = self.supervisor.estimated_pose().vector_unpack()    for i in range( len( sensor_distances ) ):    # calculate the position of the obstacle    sensor_pos, sensor_theta = self.proximity_sensor_placements[i].vector_unpack()    vector = [ sensor_distances[i], 0.0 ]    vector = linalg.rotate_and_translate_vector( vector, sensor_theta, sensor_pos )    obstacle_vectors[i] = vector   # store the obstacle vectors in the robot's reference frame        # accumulate the heading vector within the robot's reference frame    ao_heading_vector = linalg.add( ao_heading_vector,                                 linalg.scale( vector, self.sensor_gains[i] ) )                                   return ao_heading_vector, obstacle_vectors

Using the resulting ao_heading_vector as our reference for the robot to try to match, here are the results of running the robot software in simulation using only the avoid-obstacles controller, ignoring the goal point completely. The robot bounces around aimlessly, but it never collides with an obstacle, and even manages to navigate some very tight spaces:

Python Robot Programming Methods: Hybrid Automata (Behavior State Machine)

So far weve described two behaviorsgo-to-goal and avoid-obstaclesin isolation. Both perform their function admirably, but in order to successfully reach the goal in an environment full of obstacles, we need to combine them.

The solution we will develop lies in a class of machines that has the supremely cool-sounding designation of hybrid automata. A hybrid automaton is programmed with several different behaviors, or modes, as well as a supervising state machine. The supervising state machine switches from one mode to another in discrete times (when goals are achieved or the environment suddenly changed too much), while each behavior uses sensors and wheels to react continuously to environment changes. The solution was called hybrid because it evolves both in a discrete and continuous fashion.

Our Python robot framework implements the state machine in the file supervisor_state_machine.py.

Equipped with our two handy behaviors, a simple logic suggests itself: When there is no obstacle detected, use the go-to-goal behavior. When an obstacle is detected, switch to the avoid-obstacles behavior until the obstacle is no longer detected.

As it turns out, however, this logic will produce a lot of problems. What this system will tend to do when it encounters an obstacle is to turn away from it, then as soon as it has moved away from it, turn right back around and run into it again. The result is an endless loop of rapid switching that renders the robot useless. In the worst case, the robot may switch between behaviors with every iteration of the control loopa state known as a Zeno condition.

There are multiple solutions to this problem, and readers that are looking for deeper knowledge should check, for example, the DAMN software architecture.

What we need for our simple simulated robot is an easier solution: One more behavior specialized with the task of getting around an obstacle and reaching the other side.

Python Robot Programming Methods: Follow-Wall Behavior

Heres the idea: When we encounter an obstacle, take the two sensor readings that are closest to the obstacle and use them to estimate the surface of the obstacle. Then, simply set our reference vector to be parallel to this surface. Keep following this wall until A) the obstacle is no longer between us and the goal, and B) we are closer to the goal than we were when we started. Then we can be certain we have navigated the obstacle properly.

With our limited information, we cant say for certain whether it will be faster to go around the obstacle to the left or to the right. To make up our minds, we select the direction that will move us closer to the goal immediately. To figure out which way that is, we need to know the reference vectors of the go-to-goal behavior and the avoid-obstacle behavior, as well as both of the possible follow-wall reference vectors. Here is an illustration of how the final decision is made (in this case, the robot will choose to go left):

Determining the follow-wall reference vectors turns out to be a bit more involved than either the avoid-obstacle or go-to-goal reference vectors. Take a look at the Python code in follow_wall_controller.py to see how its done.

Final Control Design

The final control design uses the follow-wall behavior for almost all encounters with obstacles. However, if the robot finds itself in a tight spot, dangerously close to a collision, it will switch to pure avoid-obstacles mode until it is a safer distance away, and then return to follow-wall. Once obstacles have been successfully negotiated, the robot switches to go-to-goal. Here is the final state diagram, which is programmed inside the supervisor_state_machine.py:

Here is the robot successfully navigating a crowded environment using this control scheme:

An additional feature of the state machine that you can try to implement is a way to avoid circular obstacles by switching to go-to-goal as soon as possible instead of following the obstacle border until the end (which does not exist for circular objects!)

Tweak, Tweak, Tweak: Trial and Error

The control scheme that comes with Sobot Rimulator is very finely tuned. It took many hours of tweaking one little variable here, and another equation there, to get it to work in a way I was satisfied with. Robotics programming often involves a great deal of plain old trial-and-error. Robots are very complex and there are few shortcuts to getting them to behave optimally in a robot simulator environmentat least, not much short of outright machine learning, but thats a whole other can of worms.

Robotics often involves a great deal of plain old trial-and-error.

I encourage you to play with the control variables in Sobot Rimulator and observe and attempt to interpret the results. Changes to the following all have profound effects on the simulated robots behavior:

• The error gain kP in each controller
• The sensor gains used by the avoid-obstacles controller
• The calculation of v as a function of in each controller
• The obstacle standoff distance used by the follow-wall controller
• The switching conditions used by supervisor_state_machine.py
• Pretty much anything else

When Programmable Robots Fail

Weve done a lot of work to get to this point, and this robot seems pretty clever. Yet, if you run Sobot Rimulator through several randomized maps, it wont be long before you find one that this robot cant deal with. Sometimes it drives itself directly into tight corners and collides. Sometimes it just oscillates back and forth endlessly on the wrong side of an obstacle. Occasionally it is legitimately imprisoned with no possible path to the goal. After all of our testing and tweaking, sometimes we must come to the conclusion that the model we are working with just isnt up to the job, and we have to change the design or add functionality.

In the mobile robot universe, our little robots brain is on the simpler end of the spectrum. Many of the failure cases it encounters could be overcome by adding some more advanced software to the mix. More advanced robots make use of techniques such as mapping, to remember where its been and avoid trying the same things over and over; heuristics, to generate acceptable decisions when there is no perfect decision to be found; and machine learning, to more perfectly tune the various control parameters governing the robots behavior.

A Sample of Whats to Come

Robots are already doing so much for us, and they are only going to be doing more in the future. While even basic robotics programming is a tough field of study requiring great patience, it is also a fascinating and immensely rewarding one.

In this tutorial, we learned how to develop reactive control software for a robot using the high-level programming language Python. But there are many more advanced concepts that can be learned and tested quickly with a Python robot framework similar to the one we prototyped here. I hope you will consider getting involved in the shaping of things to come!

Acknowledgement: I would like to thank Dr. Magnus Egerstedt and Jean-Pierre de la Croix of the Georgia Institute of Technology for teaching me all this stuff, and for their enthusiasm for my work on Sobot Rimulator.