Begin with opening a picture and hit the C button for the crop tool.
By dragging the lines to the outside we get a border bases on the background color (be sure crop deleted pixels is on)
By pressing Alt you can crop on both sides (right / left or above / below).
This is a very easy way to add a simple border around your picture.
Easy quick and simple !