Yes. In fact, ChatGPT with Plugins behaves like an agent.

The idea behind these AutoGPTs is to give greater structure to the way the model thinks and acts, through a loop of planning, executing, and reflecting. Another goal is to provide the model with enhanced memory, similar to or identical to retrieval.

In short AutoGPT-like applications treat the LLM as a reasoning core around which a scaffolding of higher-order thinking is built.

It’s interesting, as a cognitive architecture. Imagine that your frontal cortex, responsible for planning, was very rigid and farmed out its actual reasoning tasks to your language-learning brain area.