FILE module
Work with local JSON data on your own computer
The file module lets you read and write data to the Data Lake. Here's a quick example of how to use the write and read methods on the file module:
When you have dealt with SQL databases before, you will find it takes a lot less effort to save data. Especially when dealing with complex data this will become apparent:
Normally, if you would save this to a sql database, you would first save the first header, capture the generated id, then save the lines with a 'foreign key' pointing to the id of the header. Then save the next line, etc. With the json datalake, you can save the entire set of journals to disk in a single operation, and read them back into memory.
Last updated