Creating a NetAI Playground for Agentic AI Experimentation

[ad_1] Hey there, everybody, and welcome to the most recent installment of “Hank shares his AI journey.” 🙂 Synthetic Intelligence (AI) continues to be all the trend, and getting back from Cisco Reside in San Diego, I used to be excited to dive into the world of agentic AI.

With bulletins like Cisco’s personal agentic AI resolution, AI Canvas, in addition to discussions with companions and different engineers about this subsequent part of AI potentialities, my curiosity was piqued : What does this all imply for us community engineers? Furthermore, how can we begin to experiment and find out about agentic AI?

I started my exploration of the subject of agentic AI, studying and watching a variety of content material to realize a deeper understanding of the topic. I received’t delve into an in depth definition on this weblog, however listed below are the fundamentals of how I give it some thought:

Agentic AI is a imaginative and prescient for a world the place AI doesn’t simply reply questions we ask, but it surely begins to work extra independently. Pushed by the objectives we set, and using entry to instruments and techniques we offer, an agentic AI resolution can monitor the present state of the community and take actions to make sure our community operates precisely as meant.

Sounds fairly darn futuristic, proper? Let’s dive into the technical elements of the way it works—roll up your sleeves, get into the lab, and let’s be taught some new issues.

What are AI “instruments?” The very first thing I wished to discover and higher perceive was the idea of “instruments” inside this agentic framework. As you could recall, the LLM (massive language mannequin) that powers AI techniques is basically an algorithm educated on huge quantities of information. An LLM can “perceive” your questions and directions. By itself, nonetheless, the LLM is restricted to the info it was educated on. It may’t even search the net for present film showtimes with out some “device” permitting it to carry out an online search.

From the very early days of the GenAI buzz, builders have been constructing and including “instruments” into AI functions. Initially, the creation of those instruments was advert hoc and different relying on the developer, LLM, programming language, and the device’s purpose. However not too long ago, a brand new framework for constructing AI instruments has gotten quite a lot of pleasure and is beginning to grow to be a brand new “customary” for device growth.

This framework is called the Mannequin Context Protocol (MCP). Initially developed by Anthropic, the corporate behind Claude, any developer to make use of MCP to construct instruments, known as “MCP Servers,” and any AI platform can act as an “MCP Shopper” to make use of these instruments. It’s important to keep in mind that we're nonetheless within the very early days of AI and AgenticAI; nonetheless, presently, MCP seems to be the strategy for device constructing. So I figured I’d dig in and work out how MCP works by constructing my very own very primary NetAI Agent.

I’m removed from the primary networking engineer to wish to dive into this house, so I began by studying a few very useful weblog posts by my buddy Kareem Iskander, Head of Technical Advocacy in Be taught with Cisco.

These gave me a jumpstart on the important thing subjects, and Kareem was useful sufficient to offer some instance code for creating an MCP server. I used to be able to discover extra by myself.

Creating a neighborhood NetAI playground lab There is no such thing as a scarcity of AI instruments and platforms right now. There may be ChatGPT, Claude, Mistral, Gemini, and so many extra. Certainly, I make the most of a lot of them usually for varied AI duties. Nonetheless, for experimenting with agentic AI and AI instruments, I wished one thing that was 100% native and didn’t depend on a cloud-connected service.

A main purpose for this need was that I wished to make sure all of my AI interactions remained completely on my pc and inside my community. I knew I'd be experimenting in a wholly new space of growth. I used to be additionally going to ship knowledge about “my community” to the LLM for processing. And whereas I’ll be utilizing non-production lab techniques for all of the testing, I nonetheless didn’t like the thought of leveraging cloud-based AI techniques. I'd really feel freer to be taught and make errors if I knew the danger was low. Sure, low… Nothing is totally risk-free.

Fortunately, this wasn’t the primary time I thought-about native LLM work, and I had a few doable choices able to go. The primary is Ollama, a robust open-source engine for operating LLMs domestically, or a minimum of by yourself server. The second is LMStudio, and whereas not itself open supply, it has an open supply basis, and it's free to make use of for each private and “at work” experimentation with AI fashions. After I learn a latest weblog by LMStudio about MCP help now being included, I made a decision to provide it a attempt for my experimentation.

<img loading="lazy" decoding="async" class="wp-image-475934 size-full" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-01.jpg" alt="Creating Mr Packets with LMStudio" width="800" height="642" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-01-300x241.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-01-768x616.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-01.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> Creating Mr Packets with LMStudio LMStudio is a consumer for operating LLMs, but it surely isn’t an LLM itself. It offers entry to a lot of LLMs accessible for obtain and operating. With so many LLM choices accessible, it may be overwhelming whenever you get began. The important thing issues for this weblog submit and demonstration are that you just want a mannequin that has been educated for “device use.” Not all fashions are. And moreover, not all “tool-using” fashions really work with instruments. For this demonstration, I’m utilizing the google/gemma-2-9b mannequin. It’s an “open mannequin” constructed utilizing the identical analysis and tooling behind Gemini.

The following factor I wanted for my experimentation was an preliminary thought for a device to construct. After some thought, I made a decision a very good “howdy world” for my new NetAI undertaking could be a approach for AI to ship and course of “present instructions” from a community machine. I selected pyATS to be my NetDevOps library of selection for this undertaking. Along with being a library that I’m very acquainted with, it has the good thing about automated output processing into JSON via the library of parsers included in pyATS. I may additionally, inside simply a few minutes, generate a primary Python perform to ship a present command to a community machine and return the output as a place to begin.

Right here’s that code:

def send_show_command( command: str, device_name: str, username: str, password: str, ip_address: str, ssh_port: int = 22, network_os: Optionally available[str] = "ios", ) -> Optionally available[Dict[str, Any]]: # Construction a dictionary for the machine configuration that may be loaded by PyATS device_dict = { "gadgets": { device_name: { "os": network_os, "credentials": { "default": {"username": username, "password": password} }, "connections": { "ssh": {"protocol": "ssh", "ip": ip_address, "port": ssh_port} }, } } } testbed = load(device_dict) machine = testbed.gadgets[device_name] machine.join() output = machine.parse(command) machine.disconnect() return output

Between Kareem’s weblog posts and the getting-started information for FastMCP 2.0, I discovered it was frighteningly simple to transform my perform into an MCP Server/Device. I simply wanted so as to add 5 traces of code.

from fastmcp import FastMCP mcp = FastMCP("NetAI Whats up World") @mcp.device() def send_show_command() . . if __name__ == "__main__": mcp.run()

Effectively.. it was ALMOST that simple. I did need to make a number of changes to the above fundamentals to get it to run efficiently. You may see the total working copy of the code in my newly created NetAI-Studying undertaking on GitHub.

As for these few changes, the modifications I made had been:

A pleasant, detailed docstring for the perform behind the device. MCP shoppers use the small print from the docstring to know how and why to make use of the device. After some experimentation, I opted to make use of “http” transport for the MCP server somewhat than the default and extra frequent “STDIO.” The rationale I went this manner was to arrange for the following part of my experimentation, when my pyATS MCP server would probably run inside the community lab surroundings itself, somewhat than on my laptop computer. STDIO requires the MCP Shopper and Server to run on the identical host system.

So I fired up the MCP Server, hoping that there wouldn’t be any errors. (Okay, to be trustworthy, it took a few iterations in growth to get it working with out errors… however I’m doing this weblog submit “cooking present model,” the place the boring work alongside the best way is hidden. 😉

python netai-mcp-hello-world.py ╭─ FastMCP 2.0 ──────────────────────────────────────────────────────────────╮ │ │ │ _ __ ___ ______ __ __ _____________ ____ ____ │ │ _ __ ___ / ____/___ ______/ /_/ |/ / ____/ __ |___ / __ │ │ _ __ ___ / /_ / __ `/ ___/ __/ /|_/ / / / /_/ / ___/ / / / / / │ │ _ __ ___ / __/ / /_/ (__ ) /_/ / / / /___/ ____/ / __/_/ /_/ / │ │ _ __ ___ /_/ __,_/____/__/_/ /_/____/_/ /_____(_)____/ │ │ │ │ │ │ │ │ 🖥️ Server title: FastMCP │ │ 📦 Transport: Streamable-HTTP │ │ 🔗 Server URL: http://127.0.0.1:8002/mcp/ │ │ │ │ 📚 Docs: https://gofastmcp.com │ │ 🚀 Deploy: https://fastmcp.cloud │ │ │ │ 🏎️ FastMCP model: 2.10.5 │ │ 🤝 MCP model: 1.11.0 │ │ │ ╰────────────────────────────────────────────────────────────────────────────╯ [07/18/25 14:03:53] INFO Beginning MCP server 'FastMCP' with transport 'http' on http://127.0.0.1:8002/mcp/server.py:1448 INFO: Began server course of [63417] INFO: Ready for software startup. INFO: Software startup full. INFO: Uvicorn operating on http://127.0.0.1:8002 (Press CTRL+C to give up)

The following step was to configure LMStudio to behave because the MCP Shopper and connect with the server to have entry to the brand new “send_show_command” device. Whereas not “standardized, “most MCP Shoppers use a quite common JSON configuration to outline the servers. LMStudio is considered one of these shoppers.

<img loading="lazy" decoding="async" class="wp-image-475935 size-full" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-02-mcpconfig.jpg" alt="Adding the pyATS MCP server to LMStudio" width="800" height="498" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-02-mcpconfig-300x187.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-02-mcpconfig-768x478.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-02-mcpconfig.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> Including the pyATS MCP server to LMStudio Wait… in the event you’re questioning, ‘The place’s the community, Hank? What machine are you sending the ‘present instructions’ to?’ No worries, my inquisitive buddy: I created a quite simple Cisco Modeling Labs (CML) topology with a few IOL gadgets configured for direct SSH entry utilizing the PATty characteristic.

<img loading="lazy" decoding="async" class="wp-image-475936 size-full" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-cml-01.jpg" alt="NetAI Hello World CML Network" width="800" height="458" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-cml-01-300x172.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-cml-01-768x440.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-cml-01.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> NetAI Whats up World CML Community Let’s see it in motion! Okay, I’m certain you're able to see it in motion. I do know I certain was as I used to be constructing it. So let’s do it!

To start out, I instructed the LLM on how to connect with my community gadgets within the preliminary message.

<img loading="lazy" decoding="async" class="size-full wp-image-475939" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-03.jpg" alt="Telling the LLM about my devices" width="800" height="498" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-03-300x187.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-03-768x478.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-03.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> Telling the LLM about my gadgets I did this as a result of the pyATS device wants the deal with and credential info for the gadgets. Sooner or later I’d like to have a look at the MCP servers for various supply of reality choices like NetBox and Vault so it will probably “look them up” as wanted. However for now, we’ll begin easy.

First query: Let’s ask about software program model data.

You may see the small print of the device name by diving into the enter/output display.

That is fairly cool, however what precisely is going on right here? Let’s stroll via the steps concerned.

The LLM consumer begins and queries the configured MCP servers to find the instruments accessible. I ship a “immediate” to the LLM to contemplate. The LLM processes my prompts. It “considers” the totally different instruments accessible and in the event that they could be related as a part of constructing a response to the immediate. The LLM determines that the “send_show_command” device is related to the immediate and builds a correct payload to name the device. The LLM invokes the device with the right arguments from the immediate. The MCP server processes the known as request from the LLM and returns the end result. The LLM takes the returned outcomes, together with the unique immediate/query as the brand new enter to make use of to generate the response. The LLM generates and returns a response to the question.

This isn’t all that totally different from what you may do in the event you had been requested the identical query.

You'll think about the query, “What software program model is router01 operating?” You’d take into consideration the other ways you could possibly get the data wanted to reply the query. Your “instruments,” so to talk. You’d determine on a device and use it to collect the data you wanted. In all probability SSH to the router and run “present model.” You’d overview the returned output from the command. You’d then reply to whoever requested you the query with the right reply.

Hopefully, this helps demystify just a little about how these “AI Brokers” work beneath the hood.

How about another instance? Maybe one thing a bit extra complicated than merely “present model.” Let’s see if the NetAI agent might help determine which swap port the host is related to by describing the essential course of concerned.

Right here’s the query—sorry, immediate, that I undergo the LLM:

<img loading="lazy" decoding="async" class="wp-image-475950 size-full" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-05-prompt.jpg" alt="Prompt asking a multi-step question of the LLM." width="800" height="262" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-05-prompt-300x98.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-05-prompt-768x252.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-05-prompt.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> Immediate asking a multi-step query of the LLM. What we must always discover about this immediate is that it'll require the LLM to ship and course of present instructions from two totally different community gadgets. Identical to with the primary instance, I do NOT inform the LLM which command to run. I solely ask for the data I would like. There isn’t a “device” that is aware of the IOS instructions. That data is a part of the LLM’s coaching knowledge.

Let’s see the way it does with this immediate:

<img loading="lazy" decoding="async" class="wp-image-475951 size-full" src="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-06-response.jpg" alt="The multi-step LLM response." width="800" height="734" srcset="https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-06-response-300x275.jpg 300w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-06-response-768x705.jpg 768w, https://storage.googleapis.com/blogs-images-new/ciscoblogs/1/2025/07/netai-lmstudio-06-response.jpg 800w" sizes="auto, (max-width: 800px) 100vw, 800px"/> The LLM efficiently executes the multi-step plan. And take a look at that, it was in a position to deal with the multi-step process to reply my query. The LLM even defined what instructions it was going to run, and the way it was going to make use of the output. And in the event you scroll again as much as the CML community diagram, you’ll see that it appropriately identifies interface Ethernet0/2 because the swap port to which the host was related.

So what’s subsequent, Hank? Hopefully, you discovered this exploration of agentic AI device creation and experimentation as attention-grabbing as I've. And possibly you’re beginning to see the chances to your personal every day use. When you’d prefer to attempt a few of this out by yourself, you'll find all the things you want on my netai-learning GitHub undertaking.

The mcp-pyats code for the MCP Server. You’ll discover each the easy “howdy world” instance and a extra developed work-in-progress device that I’m including further options to. Be happy to make use of both. The CML topology I used for this weblog submit. Although any community that's SSH reachable will work. The mcp-server-config.json file which you could reference for configuring LMStudio A “System Immediate Library” the place I’ve included the System Prompts for each a primary “Mr. Packets” community assistant and the agentic AI device. These aren’t required for experimenting with NetAI use instances, however System Prompts could be helpful to make sure the outcomes you’re after with LLM.

A few “gotchas” I wished to share that I encountered throughout this studying course of, which I hope may prevent a while: First, not all LLMs that declare to be “educated for device use” will work with MCP servers and instruments. Or a minimum of those I’ve been constructing and testing. Particularly, I struggled with Llama 3.1 and Phi 4. Each appeared to point they had been “device customers,” however they didn't name my instruments. At first, I assumed this was on account of my code, however as soon as I switched to Gemma 2, they labored instantly. (I additionally examined with Qwen3 and had good outcomes.)

Second, when you add the MCP Server to LMStudio’s “mcp.json” configuration file, LMStudio initiates a connection and maintains an energetic session. Because of this in the event you cease and restart the MCP server code, the session is damaged, providing you with an error in LMStudio in your subsequent immediate submission. To repair this concern, you’ll must both shut and restart LMStudio or edit the “mcp.json” file to delete the server, put it aside, after which re-add it. (There's a bug filed with LMStudio on this drawback. Hopefully, they’ll repair it in an upcoming launch, however for now, it does make growth a bit annoying.)

As for me, I’ll proceed exploring the idea of NetAI and the way AI brokers and instruments could make our lives as community engineers extra productive. I’ll be again right here with my subsequent weblog as soon as I've one thing new and attention-grabbing to share.

Within the meantime, how are you experimenting with agentic AI? Are you excited concerning the potential? Any solutions for an LLM that works effectively with community engineering data? Let me know within the feedback beneath. Speak to you all quickly!