Actions and Tasks¶
Actions: A Start and a Finish¶
A higher-level construct than messages is the concept of an action. An action can be started, and then finishes either successfully or with some sort of an exception. Success in this case simply means no exception was thrown; the result of an action may be a successful response saying “this did not work”. Log messages are emitted for action start and finish.
Actions are also nested; one action can be the parent of another.
An action’s parent is deduced from the Python call stack and context managers like
Log messages will also note the action they are part of if they can deduce it from the call stack.
The result of all this is that you can trace the operation of your code as it logs various actions, and see a narrative of what happened and what caused it to happen.
Here’s a basic example of logging an action:
from eliot import start_action with start_action(action_type=u"store_data"): x = get_data() store_data(x)
This will log an action start message and if the block finishes successfully an action success message. If an exception is thrown by the block then an action failure message will be logged along with the exception type and reason as additional fields. Each action thus results in two messages being logged: at the start and finish of the action. No traceback will be logged so if you want a traceback you will need to do so explicitly. Notice that the action has a name, with a subsystem prefix. Again, this should be a logical name.
Note that all code called within this block is within the context of this action.
While running the block of code within the
with statement new actions created with
start_action will get the top-level
start_action as their parent.
If you want to log the inputs and results of a function, you can use the
from eliot import log_call @log_call def calculate(x, y): return x * y
This will log an action of type
calculate with arguments
y, as well as logging the result.
You can also customize the output:
from eliot import log_call @log_call(action_type="CALC", include_args=["x"], include_result=False) def calculate(x, y): return x * y
This changes the action type to
CALC, logs only the
x argument, and doesn’t log the result.
Tasks: Top-level Actions¶
A top-level action with no parent is called a task, the root cause of all its child actions.
E.g. a web server receiving a new HTTP request would create a task for that new request.
Log messages emitted from Eliot are therefore logically structured as a forest: trees of actions with tasks at the root.
If you want to ignore the context and create a top-level task you can use the
From Actions to Messages¶
While the logical structure of log messages is a forest of actions, the actual output is effectively a list of dictionaries (e.g. a series of JSON messages written to a file). To bridge the gap between the two structures each output message contains special fields expressing the logical relationship between it and other messages:
task_uuid: The unique identifier of the task (top-level action) the message is part of.
task_level: The specific location of this message within the task’s tree of actions. For example,
[3, 2, 4]indicates the message is the 4th child of the 2nd child of the 3rd child of the task.
Consider the following code sample:
from eliot import start_action, start_task, Message with start_task(action_type="parent"): Message.log(message_type="info", x=1) with start_action(action_type="child"): Message.log(message_type="info", x=2) raise RuntimeError("ono")
All these messages will share the same UUID in their
task_uuid field, since they are all part of the same high-level task.
If you sort the resulting messages by their
task_level you will get the tree of messages:
task_level= action_type="parent" action_status="started" task_level= message_type="info" x=1 task_level=[3, 1] action_type="child" action_status="started" task_level=[3, 2] message_type="info" x=2 task_level=[3, 3] action_type="child" action_status="succeeded" task_level= action_type="parent" action_status="failed" exception="exceptions.RuntimeError" reason="ono"
You can add fields to both the start message and the success message of an action.
from eliot import start_action with start_action(action_type=u"yourapp:subsystem:frob", # Fields added to start message only: key=123, foo=u"bar") as action: x = _beep(123) result = frobinate(x) # Fields added to success message only: action.add_success_fields(result=result)
If you want to include some extra information in case of failures beyond the exception you can always log a regular message with that information. Since the message will be recorded inside the context of the action its information will be clearly tied to the result of the action by the person (or code!) reading the logs later on.
Generators (functions with
yield) and context managers (
with X:) don’t mix well in Python.
So if you’re going to use
with start_action() in a generator, just make sure it doesn’t wrap a
yield and you’ll be fine.
Here’s what you SHOULD NOT DO:
def generator(): with start_action(action_type="x"): # BAD! DO NOT yield inside a start_action() block: yield make_result()
Here’s what can do instead:
def generator(): with start_action(action_type="x"): result = make_result() # This is GOOD, no yield inside the start_action() block: yield result
Sometimes you want to have the action be the context for other messages but not finish automatically when the block finishes.
You can do so with
You can explicitly finish an action by calling
If called with an exception it indicates the action finished unsuccessfully.
If called with no arguments it indicates that the action finished successfully.
from eliot import start_action action = start_action(action_type=u"yourapp:subsystem:frob") try: with action.context(): x = _beep() with action.context(): frobinate(x) # Action still isn't finished, need to so explicitly. except FrobError as e: action.finish(e) else: action.finish()
context() method returns the
from eliot import start_action with start_action(action_type=u"your_type").context() as action: # do some stuff... action.finish()
You shouldn’t log within an action’s context after it has been finished:
from eliot import start_action, Message with start_action(action_type=u"message_late").context() as action: Message.log(message_type=u"ok") # finish the action: action.finish() # Don't do this! This message is being added to a finished action! Message.log(message_type=u"late")
As an alternative to
with, you can also explicitly run a function within the action context:
from eliot import start_action action = start_action(action_type=u"yourapp:subsystem:frob") # Call do_something(x=1) in context of action, return its result: result = action.run(do_something, x=1)
Getting the Current Action¶
Sometimes it can be useful to get the current action.
For example, you might want to record the current task UUID for future reference, in a bug report for example.
You might also want to pass around the
Action explicitly, rather than relying on the implicit context.
You can get the current
Action by calling
from eliot import current_action def get_current_uuid(): return current_action().task_uuid