A second bullet inside the Olympic equestrian centre was found close to the stable area on Wednesday, the second time a stray shot has been picked up at the venue over the past week, police said.

No one was injured and the first day of the dressage competition finished as normal.

On Saturday, a stray bullet tore through the roof of the equestrian press centre, passing over the head of the New Zealand press attache and landing at the feet of a photographer.

The defence minister said it may have been fired by a gang member trying to shoot down a police blimp.

The police blimp, which carries cameras to monitor the surrounding area, was flying on Tuesday during the final day of the eventing competition.

Police arrested a man accused of firing the shot on Saturday in a community about two kilometres away from the venue, General Luis Ramos told reporters.

During the arrest more shots were fired, possibly explaining the second bullet.

A representative for the German equestrian team said they took the incident quite seriously but had been assured security forces would do whatever possible to protect horses and humans.

The Deodoro equestrian area is next to a military complex and riders and fans have heard gun shots periodically since competition began last week.

Ramos confirmed the army had been conducting training exercises but promised to stop them so as not to spook the horses.