Why don’t we write a database file system? Isn’t a file system practically a database already? Isn’t layering an OS between the data and the database application slowing things down?
In: Engineering
We already have a few examples, apache spark (basis of data bricks) does this.
A database, at its simplest, is made up of tables with rows and columns. You can store these as files, a good way to do this is having each column as a file (this is how apache spark works, with parquet being the file format, and those files being stored on a file system (aws s3).
It works incredibly well at some things, less well at others.
Latest Answers