Big Data Trendz

There are a lot of nice videos in YouTube from  tops for kids  to  machine learning . Some of these videos are so interesting, feel like viewing them again and again. When you find this pattern, it's better to download the videos. Not only does this allow for offline view, but also save the bandwidth.  Bandwidth cap  makes this even more useful. `youtube-dl` is a very useful command to download files from YouTube in Ubuntu. `youtube-dl`has got a lot of nice options, here are some of the options I use youtube-dl -c -t -f 5 --batch-file=files.txt -c -> resume partially downloaded file -t -> Use the title of the video in the file name used to download the video -f -> Specify the video format (quality) in which to download the video. --batch-file -> Specify the name of a file containing URLs of videos to download from youtube in batch mode. The file must contain one URL per line.

Google has unique requirements with respective to data processing and storage which no one has. According to the WikiPedia , Google has to process about 24 Peta Bytes of data per day which be a bit outdated and Google might be processing more data per day. So, they need to continuously innovate to address the unique requirements. Soon they outgrow the innovation and they come up with some new innovation. The good thing is that Google had been continuously  releasing  these innovations  as papers once they have it refined and there is a solid internal implementation of it. These Google Papers have been implemented by the  ASF (Apache Software Foundation) and others. It's taking some time for the ASF frameworks like Hadoop and others to production ready. There is a catchup between Google papers and the ASF on a continuous basis. Google Paper Apache Frameworks The Google File System  (October, 2003) HDFS  (2008 became Apache TLP) MapReduce:...