Monday, June 8, 2015


1:08 PM - By ajay desai 0

The name  node file system maintains metadata in two of its files: -

1) fsImage
2) Edit log


                            (1) FS IMAGE

This file is a checkpoint of the HDFS metadata.

All the metadata information of a file like: -

(i) No: of blocks allocated for a file.

(ii) Physical address of those blocks.

(iii) Which blocks are present on which data nodes.

The usual size of this of this file is GBs. Whenever the name node fails, the latest state of metadata stored in fsImage file can be re-constructed by loading that data from name node hard disk to main memory.

The secondary name node loads this metadata and the information about the recent write operations performed by the name node present in edit log into its memory and begins its job

                      (2) EDIT LOG

When the client performs a write operation like creating a file. This operation is first recorded in edit log. And then the information about this operation is updated into fsImage and the edit log's contents are flushed.

As writing metadata information to fsImage takes a lot of time because of its huge size, a file called edit log is maintained by name node, which contains information about the recent write operations performed like creating or moving a file.

About the Author

I am Azeheruddin Khan having more than 6 year experience in c#, and ms sql.My work comprise of medium and enterprise level projects using and other Microsoft .net technologies. Please feel free to contact me for any queries via posting comments on my blog,i will try to reply as early as possible. Follow me @fresher2programmer
View all posts by admin →

Get Updates

Subscribe to our e-mail newsletter to receive updates.

Share This Post



© 2014 Fresher2Programmer. WP Theme-junkie converted by Bloggertheme9
Powered by Blogger.
back to top