Futures

Easy Async

Futures are a powerful tool in Dandy that allow you to run code asynchronously which is great for non-blocking calls like network requests.

All you need to do on any class that has a process method is to call the process_to_future method instead.

Without Async Futures

Let's run three LlmBot.process calls at once and see how long it takes.

from time import perf_counter
from dandy.llm import LlmBot

start_time = perf_counter()

pants_intel = LlmBot.process('What type of pants should I wear in the rain?')
shirt_intel = LlmBot.process('What type of shirt should I wear in the sun?')
shoes_intel = LlmBot.process('What type of shoes should I wear in the mud?')

print('Pants: ' + pants_intel.text)
print('Shirt: ' + shirt_intel.text)
print('Shoes: ' + shoes_intel.text)

print(f'Finished in {perf_counter() - start_time:.3f} seconds')

Pants: Wear waterproof or water-resistant pants when it's raining to stay dry.
Shirt: Wear a lightweight, breathable shirt made from materials like cotton or linen to stay cool in the sun.
Shoes: For muddy conditions, it's best to wear waterproof boots with good traction. These will keep your feet dry and provide the necessary grip to prevent slipping.
Finished in 1.931 seconds

With Async Futures

Now let's run with futures, note you have to access the result attribute of the futures to get to the returned value.

Warning

We recommend you postfix your futures with _future to avoid naming conflicts and confusion.

from time import perf_counter
from dandy.llm import LlmBot

start_time = perf_counter()

pants_intel_future = LlmBot.process_to_future('What type of pants should I wear in the rain?')
shirt_intel_future = LlmBot.process_to_future('What type of shirt should I wear in the sun?')
shoes_intel_future = LlmBot.process_to_future('What type of shoes should I wear in the mud?')

print('Pants: ' + pants_intel_future.result.text)
print('Shirt: ' + shirt_intel_future.result.text)
print('Shoes: ' + shoes_intel_future.result.text)

print(f'Finished in {perf_counter() - start_time:.3f} seconds')

Pants: Wear waterproof or water-resistant pants when it's raining to stay dry.
Shirt: Wear a lightweight, breathable shirt made from materials like cotton or linen to stay cool in the sun.
Shoes: For muddy conditions, it's best to wear waterproof boots with good traction. These will keep your feet dry and provide the necessary grip to prevent slipping.
Finished in 1.518 seconds

Advanced Async

Sometimes in more complex situations you might need to cancel a future or set a timeout.

from dandy.llm import LlmBot

user_likes_scary_animals = True

cute_animal_future = LlmBot.process_to_future('Can you tell me about a random cute animal?')

scary_animal_future = LlmBot.process_to_future('Can you tell me about a random scary animal?')
scary_animal_future.set_timeout(seconds=5)

if user_likes_scary_animals:
    cute_animal_future.cancel()

print(scary_animal_future.result.text)

Sure! One scary animal is the Komodo dragon. It's the largest living lizard, growing up to 10 feet long and weighing over 300 pounds. These reptiles are native to Indonesia and have venomous saliva that can cause infection in their prey. They're also known for their powerful jaws and sharp teeth, which they use to hunt large animals like deer and wild boar. Despite their fearsome reputation, Komodo dragons are actually quite shy around humans and will only attack if provoked.