Passing Nested Dictionary To Emr Via Add_job_flow_steps

I create a python dictionary called my_dict with some metadata. I convert my_dict to a string via json.dumps(). my_dict is then passed to EMR via add_job_flow_steps as args in Hado

Solution 1:

I was able to resolve this by adding another key value pair to the end of the dictionary that is not nested. Like this:

--my_arg "{\"level_one_key\": {\"level_two_key\": \"level_two_value\"}, \"level_one_second_key\": \"level_one_second_value\"}"