Sol Buckner's troops were on the back foot from the start being overrun in middle of the pitch.
A tactical switch saw 4-4-2 changed to 4-5-1 but the hosts still found a way through from a short corner.
Saxons held firm until the break and looked more solid in all departments.
But disaster struck minutes after the break when a defensive mistake let a Crowborough striker fire a shot under keeper Derek Pharoah.
Then on 42 minutes another mistake allowed the same striker to rifle in from top D.
Saxons rallied briefly and earned a short corner on the hour which Jo Woodford gratefully fired straight past the keeper.
But Crowborough were hungry for more and they grabbed a fourth from a short corner on 65 minutes to wrap up the game.
Skipper Buckner said: "We weren't at our best and paid the price for a some mistakes.
"We're looking forward to our first home game in six weeks."
Report from Sol Buckner