Use Off Grid AI’s asynchronous request flow: submit the job with ?async=true, save the returned request_id, then poll that request’s status and result separately. Your client no longer needs to keep the original HTTP connection open for the entire model run. A timeout in your polling code does not, by itself, cancel work on the gateway.
How the asynchronous request flow works
Off Grid AI (OGAD) describes a local OpenAI-compatible gateway at http://127.0.0.1:7878/v1. Check the address and port in your running installation rather than assuming the example is unchanged. The gateway’s official repository describes local inference and fully offline operation; async handling changes how your client waits, not whether a task needs network access to an external service. Off Grid AI’s repository
As an Amazon Associate I earn from qualifying purchases.
- Start OGAD and load the local model you intend to use.
- Call
GET /v1/modelsand choose an installed model. Use its actual ID rather than copying one from an example. - Send your normal request body to a supported endpoint with
?async=true. The documented flow returns HTTP 202 and a request ID; keep that ID. - Poll
/v1/requests/{request_id}using the ID from the response. - When the request completes, read its result using the response schema for the original endpoint.
The flow and response examples are described in the Off Grid AI async requests guide. The repository lists chat, image, audio, embeddings, and model-list endpoints, and points to /docs and /openapi.json on the running gateway. Check those references in your installed release for the exact route, schema, and supported async behavior.
Python example: submit, poll, and retrieve a chat result
This Python 3 example uses only the standard library. It discovers a model, submits a chat request, and polls the same request ID every two seconds. The per-request HTTP timeout is 30 seconds; the five-minute polling deadline is a client-side limit chosen for this example, not a server runtime limit or cancellation mechanism.
#1 Best Overall
- Ultra-Lightweight: At only 7.5 lbs, the Explorer 300 delivers a robust 292Wh capacity while remaining 17% lighter than the industry average. The sleek, integrated handle makes it effortless to carry on long hikes or pack with your camping gear, providing reliable off-grid power without adding bulk to your load.
- Versatile Power for 6 Devices: Equipped with 2 AC outlets, a 100W USB-C PD port, 2 USB-A ports, and a 120W car port. With a 300W rated output (600W peak surge), it easily handles laptops, drones, and cameras, while also serving as a dependable cpap battery for camping or a robust solar powered generator when paired with panels.
- Built to Last: Upgraded with premium LiFePO4 chemistry, this portable generator delivers over 4,000 charge cycles before reaching 70% capacity. This ensures more than 11 years of reliable service life, making it a sustainable and durable energy partner for a decade of exploration.
- Fast Solar Charging: Perfect for off-grid use, this solar powered generator pairs seamlessly with Jackery panels. Reach 80% capacity in approximately 2.8 hours with a 100W solar panel, or maintain your gear with a portable 40W panel (80% in 7.5 hours), making it an essential part of your hunting essentials.
- WHAT YOU GET: 1* Jackery Explorer 300 Portable Power Station, 1*AC adapter, 1* car charger cable, 1* user guide (𝐒𝐨𝐥𝐚𝐫 𝐏𝐚𝐧𝐞𝐥 𝐍𝐨𝐭 𝐈𝐧𝐜𝐥𝐮𝐝𝐞𝐝.)
import json
import time
from urllib.error import HTTPError, URLError
from urllib.request import Request, urlopen
BASE = "http://127.0.0.1:7878/v1"
HTTP_TIMEOUT_SECONDS = 30
POLL_INTERVAL_SECONDS = 2
POLL_DEADLINE_SECONDS = 5 * 60
def get_json(url):
request = Request(url, headers={"Accept": "application/json"})
with urlopen(request, timeout=HTTP_TIMEOUT_SECONDS) as response:
return json.load(response)
def post_json(url, payload):
body = json.dumps(payload).encode("utf-8")
request = Request(
url,
data=body,
headers={"Content-Type": "application/json", "Accept": "application/json"},
method="POST",
)
with urlopen(request, timeout=HTTP_TIMEOUT_SECONDS) as response:
return json.load(response)
# Discover an installed model; choose the one appropriate for your task.
models = get_json(f"{BASE}/models").get("data", [])
if not models:
raise RuntimeError("No models were returned by /v1/models")
model_id = models[0]["id"]
# Submit once, then retain the ID returned by the gateway.
submitted = post_json(
f"{BASE}/chat/completions?async=true",
{
"model": model_id,
"messages": [{"role": "user", "content": "Summarize the main idea of async polling."}],
},
)
request_id = submitted["request_id"]
# Poll until a terminal state or this client's deadline.
deadline = time.monotonic() + POLL_DEADLINE_SECONDS
while time.monotonic() < deadline:
try:
status = get_json(f"{BASE}/requests/{request_id}")
except (HTTPError, URLError, TimeoutError) as exc:
raise RuntimeError(
f"Could not check request {request_id}; verify that OGAD is running "
"before submitting another job."
) from exc
state = status.get("status")
if state == "completed":
result = status.get("result")
print(json.dumps(result, indent=2))
break
if state == "failed":
raise RuntimeError(f"Request failed: {status.get('error', status)}")
if state not in ("queued", "running"):
raise RuntimeError(f"Unexpected request state: {status}")
time.sleep(POLL_INTERVAL_SECONDS)
else:
# This ends the client loop; it does not cancel the gateway's task.
print(f"Still waiting. Keep request ID to check later: {request_id}")The example uses the documented chat-completion route. For image generation or another endpoint, verify the request and result schema in the running API reference; a shared polling route does not mean every endpoint has the same result structure.
What to do with each request state
queuedorrunning: continue polling with the same ID. Do not create a second request simply because the first is still working.completed: read and save the result. Interpret it according to the endpoint that created the job.failed: surface the returned error and investigate the model or input before deciding whether to retry.- Polling cannot connect: check that OGAD is still running before submitting another job; otherwise you could duplicate work.
- Your polling deadline expires: retain the ID if you plan to check that job again while the gateway remains available. Ending the client loop does not establish that the server stopped the task.
Choosing between one long connection and async polling
A synchronous request is simpler when the operation is short and the client can safely keep one HTTP connection open. Async polling separates submission from result retrieval, which is useful when a long-running operation would otherwise outlast the client’s connection or interface wait. The documented OGAD guide describes the async path, but does not establish a versioned maximum duration or timeout limit for synchronous requests.
Rank #2
- 【SLIM & POCKETABLE】This portable power bank is about the size of a smartphone (6.5×3.3×4 inches) and weighs only 2.54 pounds. It features an ergonomic soft handle for easy portability. It easily fits into a backpack for convenient portability. Pro Tip: Fully charge and discharge the battery twice initially for the best experience.(Solar panel and cable not included)
- 【DUAL INPUT/OUTPUT (AC + DC)】The portable power station comes with a 89.6Wh capacity LiFePO4 battery pack(not NCM) and 100W, features 7 output ports, including 2 AC sockets (100W),2 USB-C port (45W/15W), 2 USB-A port (18W/15W), and DC5521 ports (60W). The LED display can clearly show the working status and remaining power.(Please peel off the protective film on the screen after unboxing)
- 【Ultra Fast Charging】With unique fast charging technology,the portable generator can be charged from 0-80% just in 1.5hrs. The solar power bank power station has Four methods to charging: AC wall socket fast charging, USB-C DC two-way PD fast charging(AC and DC can be charged at the same time) ,car charging and solar panel charging.Fast charging solar power bank portable charger suitable for for emergency home backyard outdoor power outages off-grid camping essentials
- 【ULTRA-QUIET & EMERGENCY-READY POWER STATION】Experience silent, fanless operation perfect for sleeping, working, or camping, while the built-in 4-level LED flashlight (with steady/SOS modes) ensures emergency readiness. Its accidental-touch-proof design requires a long-press to activate, ideal for charging devices during outages or outdoor adventures without noise disruption.(Only suitable for powering devices within 100W).
- 【Long-Lasting & Safe LiFePO4 Battery】: 3500+ life cycles (far exceeding standard batteries). Durable LiFePO4 batteries last 3x longer than standard lithium batteries! Advanced BMS provides 12 safety protections, monitoring voltage, current & temperature. Powers your smartphone, laptop, mini-fridge, camera, and drone simultaneously.
| Consideration | One synchronous request | Async submit and poll |
|---|---|---|
| Connection lifetime | The client waits on the original HTTP response until it finishes or a timeout occurs. | The initial submission returns a request ID; later status checks use separate HTTP requests. |
| Showing pending status | The client generally waits for the response rather than checking a separate job state. | The client can display queued or running status while polling. |
| Retry and duplicate-work handling | If the connection fails, the client may not know whether the request finished; confirm behavior before blindly resubmitting. | Keep polling the same request ID while it is pending, and check gateway availability before replacing a request that cannot be reached. |
| Recovery across gateway restart | The cited guide does not establish durable recovery behavior for a synchronous request. | The guide says request records are held in memory and lost on gateway restart; save important inputs and completed outputs in your own application. |
Polling interval, deadline, and recovery
Choose a reasonable polling interval
The OGAD example uses a two-second pause; treat that as an example, not a universal requirement. Polling less often reduces repeated status calls but may delay the moment your client notices completion. Use a backoff strategy if repeated checks are unnecessary; Google Cloud’s guidance for its own long-running operations gives 10 seconds as an example, but that is not an OGAD requirement. Google Cloud long-running operations guidance
Recommended Free Tools
Separate a client deadline from server cancellation
Set a client deadline so your application can stop waiting interactively and report that the job is still pending. Do not describe that deadline as cancelling the server task unless the installed API explicitly supports cancellation. Preserve the request ID if the same running gateway can be checked later.
Rank #3
- [288Wh On-the-Go Power] - Only 9.4 lbs lightweight, carry it anywhere during storms! 288Wh capacity meets daily & outdoor needs—camping, road trips, beach visits, or home emergencies. Extend your smart green energy life to every corner of your ideal lifestyle with this compact entry-level power station.
- [600W Continuous & 1500W Surge Power] - Get a full 600W output—twice as much as others. When you need serious power, activate Power Lifting Mode for 1500W power (vs. the typical 600W). It runs everything from essential camping lights, speakers, and car fridges to critical devices like laptops and CPAP machines and even a small kettle or toaster—ideal for stormy days at home or outdoor trips.
- [50% Lower Power Consumption] - Upgraded UltraCell tech & smart cooling system cut power consumption by 50%. Enhances overall energy efficiency, extends device runtime. Excellent durability & environmental adaptability for extreme outdoor climates and long-term operation.(Standby power only 4.5W, DC 5W, AC 8W)
- [8 Charging Modes & 380W Fast Wall Charge] - Supports AC wall charge (380W/200W adjustable), solar, car charging, etc. 0-80% in 45 mins, 0-100% in 70 mins (battery-safe). Match PV60L solar panel for on-the-go recharging. Flexible charging solutions for city, wilderness, daily or emergency scenarios.
- [Reliable UPS] - Never lose data or stop your devices during winter storms/blackouts! 10ms ultra-fast UPS switch protects CPAP, laptops, routers—critical for home emergencies when power cuts suddenly.
Plan for process restarts and request-record limits
The OGAD guide describes request records as in-memory, lost on restart, and bounded to 500 records. It does not identify the exact API release for those details, so verify them in the API reference for your installed version before relying on the limit or restart behavior. Store inputs and any completed results your application must preserve outside the gateway.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Check endpoint support in your installed gateway
The repository lists POST /v1/chat/completions, POST /v1/images, audio endpoints, POST /v1/embeddings, and GET /v1/models. A separate Off Grid AI article notes that long-running operations such as image generation can use async handling with a poll URL, but confirm the specific route and response shape rather than assuming that every endpoint behaves identically. Async request guide and Off Grid AI tools guide.
Quick Recap
Best Value
- 𝐔𝐩 𝐭𝐨 𝟑𝟓-𝐇𝐨𝐮𝐫 𝐅𝐫𝐢𝐝𝐠𝐞 𝐁𝐚𝐜𝐤𝐮𝐩: With 6W idle power draw and 10% higher efficiency, this power station runs 20% longer than other 2kWh systems, keeping your fridge powered for 35 hours.
- 𝟏𝟎,𝟎𝟎𝟎-𝐂𝐲𝐜𝐥𝐞 𝐋𝐅𝐏 𝐁𝐚𝐭𝐭𝐞𝐫𝐲: Powered by 314Ah LFP cells, S2000 has a 15-year lifespan, equivalent to 10,000 charge cycles.
- 𝐒𝐦𝐚𝐥𝐥𝐞𝐬𝐭 𝐚𝐧𝐝 𝐋𝐢𝐠𝐡𝐭𝐞𝐬𝐭 𝟐𝐤𝐖𝐡 𝐏𝐨𝐰𝐞𝐫 𝐒𝐭𝐚𝐭𝐢𝐨𝐧: 30% smaller and 25% lighter than the industry average, this power station measures just 8.2 × 11.1 × 12.7 in and weighs only 35.7 lbs.
- 𝐏𝐨𝐰𝐞𝐫𝐬 𝟗𝟗% 𝐨𝐟 𝐇𝐨𝐦𝐞 𝐄𝐬𝐬𝐞𝐧𝐭𝐢𝐚𝐥𝐬: 1,500W continuous output and 3,000W peak output keep nearly every essential appliance running. Actual runtime will vary depending on your refrigerator model, usage habits, and ambient temperature.
- 𝟔 𝐖𝐚𝐲𝐬 𝐭𝐨 𝐑𝐞𝐜𝐡𝐚𝐫𝐠𝐞: Supports up to 400W solar input. Power up via AC + solar, a wall outlet, a generator, solar panels, an alternator charger, or a car outlet—anytime, anywhere.
Rank #4
- Powerful yet Compact: Boasting a 1,500W AC output and a 3,000W surge peak, the Solar Generator 1000 V2 can power multiple appliances, including AC units, fridges, and electric pots. With a 1,070Wh capacity and a lightweight build of only 23.8 lbs, along with a foldable handle, it makes an excellent companion for outdoor camping, road trips, or emergencies.
- One Hour Fast Charging: Charge your Explorer 1000 v2 Portable Power Station from 0% to 100% battery level in just one hour with emergency charging activated via the Jackery App. It defaults to 1.7 hours for a full charge to optimize battery health. Engineered with advanced ChargeShield 2.0 technology, this power station charges safer, faster, and smarter.
- 10 Year Lifespan: The Explorer 1000 v2 portable power station is equipped with a durable LFP battery, maintaining over 70% of its original capacity even after 4,000 charge cycles, offering longevity exceeding 10 years.
- Tailored for Versatility: Featuring two USB-C ports, one USB-A port, one DC car port, and three pure sine wave AC ports, along with LED lights, the Solar Generator 1000 V2 is capable of charging multiple devices simultaneously, meeting power needs in various scenarios. PD 100W fast USB-C charging ensures a rapid charging speed, even without power adapters.
- Smart App Control: Effortlessly switch between different charging modes with Jackery’s App—including one hour emergency charging from 0 to 100%, 30 dB quiet overnight charging mode, and energy efficiency mode. Maximize the freedom to adjust the power station to meet your needs.
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
