Posts

Showing posts from 2014

Tragic, Magic Sunderbans

Image
We have been living in Calcutta for so long and yet rarely do we find the time to visit the Sunderbans, a UNESCO World Heritage Site, that is just next door. The Sunderbans is famous for two things, first the Royal Bengal Tiger and the unique estuarine-mangrove ecosystems that has protected Calcutta and Bengal from the fury of many Bay of Bengal cyclones and the resultant tidal bores. In the context of global warming and the rise in the level of the sea, it is very likely that a hundred years from now the Sunderbans will get submerged and then live on only in history and in people's memory. Hopefully, these pictures will help us remember this tragic, magic land! Our destination was the Royal Bengal Resort, near the Sajnekhali Reserve Forest But we started off from Godkhali, 100km from Calcutta, just beyond Canning and right across the Bidyadhari River from Gosaba, one of the largest and busiest bazaar/village in the Sunderbans. There are no roads in the Sunderba...

Three Myths and a Lie : Charbak Unplugged

Image
The world today is awash in lies and myths, because nothing is what it seems to be. Paid media, biased press -- no one seems to be telling the truth anymore. Is this how it is supposed to be ? As an aside, any analysis of philosophy in India invariably begins with a commentary, or denunciation, of Charbak’s philosophy of extreme materialism -- reenam kritwa, ghreetam pibet! Borrow money and have fun. Now that we have invoked Charbak, let us get along with our thoughts. image from http://thedailybanter.com/2014/03/the-top-10-most-egregious-republican-lies/ There are so many lies floating around that it is not too difficult to pick any three of them. Consider the fallacy of the demographic dividend that has been tomtommed by everyone from an opportunist Nobel Laureate to the semi-literate leftist. The main thesis is that if a country has lots and lots of young people it will automatically become an economic powerhouse. Why? Because young people can work. What it ignores com...

Liberty Schools : Putting Education on Steroids

Image
The Green Revolution freed India from the spectre of famine by using technology aggressively and effectively to boost agricultural productivity. Operation Flood made India not only a milk sufficient nation but also the world’s largest producer of milk. Education, on the other hand, is still one of India’s greatest weaknesses because the Government has been a spectacular failure in delivering even primary education to vast swathes of our population. The depth of this tragedy is evident when the Prime Minister has to admit that even after 68 years of independence, most of our schools do not have toilets -- let alone labs, libraries and broadband internet ! What we need is the equivalent of a Green Revolution, an Operation Flood that will give a huge, non-linear, exponential boost to our delivery model so that educational services can reach each and every corner of the country. We need both quantity and quality and we need it in the next 5 years. Is this possible ? Why not ? ...

MindNet

Image
An internet of minds Aldous Huxley in his book, The Doors of Perception, a travelogue of his mescaline-fuelled trip through the mental landscape, compares the mind to a reducing valve. Every sentient individual is in touch with and is aware of all that is happening anywhere else but to preserve sanity in the face of an intolerable information overload, the mind chokes off most of the information and restricts itself to the safety and comfort of his local environment. The concept of a universal mind or consciousness, the brahman , of which an individual or atman is but an image is also the foundation of Sankara’s Advaita Vedanta. Both Huxley and Sankara in their own way suggest that all “minds” in the universe are somehow connected together and are in a position to share information. Doesn’t this ring a bell somewhere ? image Peace of Mind by Dokon taken from urbantimes.co A telephone bell perhaps ? Since every telephone on this planet is connected, or certainly connecta...

Introduction to Hadoop

My effort to learn Hadoop and Map Reduce resulted in the presentation. If you like it and find it useful do leave a comment.

Forecasting Retail Sales - Linear Regression with R and Hadoop

Image
image from Responsemagazine.com A retail store tracks the volume of sale for each stock-keeping-unit (SKU) that the store deals with. Given the sales for days 1 through 5, is it possible to predict the sales on days 6 through 10 ? Common sense dictates that sales will remain constant and the average sales per day for the first 5 days will be the same as the average sales per day for the next 5 days. However this may not always be the case, if there is a rising or falling trend. If there is a strongly rising trend, caused by a some strong promotional activity, then the assumption of constant sale will lead to a stock-out and loss of potential business. Similarly, if there is a strongly falling trend, then a similar assumption will lead to accumulation of dead stock and hence a loss related to excessive inventory. Instead of days, the same analysis can be done on the basis of weeks, fortnights or even month. Net-net given the sales over 5 periods of time, it is useful to be able to ...

HIVE and PIG to simplify Hadoop

Image
[Note]   -- Hadoop, IMHO, is history. Rather than waste time with all this, suggest you check up my blog post on  Spark with Python . When I was doing engineering at IIT, Kharagpur, the computers that we had were not even as powerful as a low-cost non-smart phone today and other than the basic concept of programming, nothing that we learnt is of any relevance today. So when we start a teaching a course on Business Analytics , that lies at the bleeding edge of  current technology and business practices, there is simply no option but to take the Do-It-Yourself approach of first learning a subject and then teaching it to students. Fortunately, there are many kind and knowledgeable souls on this planet who have taken the pains to explain new and difficult concepts to ancients like us and thanks to Google, it is not too difficult to locate them. Using this route, I first learnt what is Data Science and then created this compilation of tutorials and training materials th...