Writing a Hebrew dictionary with XeLaTeX

My answer is yes, but you'll have to do a lot of learning. Here are some places to start you off:

See here on how to write a hebrew book in 2 columns.

The black chapter markers are called Thumb-indexes and you can make them using fancyhdr package, info here.