The output of running a problem suite is a next dictionary that can easily be converted into json:

--------
problem
--------
Normal case:
problem = {
	name: name of problem <string>
	cases: test case results <list(case)>
	passed: <bool>
}

Critical error occured (Syntax, Indentation, FunctionNotFound):
problem = {
	name: name of problem <string>
	critical_error: details of error <exception_data>
	passed: False <bool>
}

----
case
----
Normal:
case = {
	name: name of test case <string>
	parts: test part results <list(part)>
	passed: all parts passed <bool>
}

Exception occured:
case = {
	name: name of test case <string>
	exception: details of exception <exception_data>
	passed: False <bool>
}

----
part
----
Part passed:
part = {
	description: <string>
	passed: True <bool>
}

Part failed:
part = {
	description: <string>
	passed: False <bool>
	error_message: <string>
}

--------------
exception_data
--------------
exception_data = {
	name: class name of exception <string>
	detail: extra info <string>
	critical: does exception prevent all tests from being run <bool>
}