He trusts her. If he didn't trust her, he wouldn't be in her pocket right now. Aglet is well aware how clumsy Beans can be and how badly he could be hurt even by accident, but he feels safer than he actually is while surrounded by all this fabric instead of riding in her hands.

"And you tried going back the way you came?" Aglet's not trying to be sarcastic or critical; this is a thing he's had trouble with himself.