Sol Buckner's side laid siege on the visitor's goal in the first half but could not find a way past a keeper in inspired form.
Tom Giles was an inch from breaking the deadlock on 11 minutes with a shot flying just wide.
The second half saw the visitors push back into the game and they finally broke the deadlock on a quick counter attack.
With minutes left Buckner pounced on a close range chance but he was judged to have obstructed the goalkeeper.
Buckner said: "It was a very frustrating afternoon. We deserved at least a point."
Saxons play away against Crowborough IV tomorrow with a 12pm push back.
Man of match: Matt Stevens
Team: Heath, Roberts, Pickard, Stevens, Kellett, Buckner, Merison, Bosden, Giles, Whitaker, Waters, Cattell.