Current Week Objectives: Dive deep into Hadoop and a little bit on SQLite
Current Week Accomplishments/Hours Worked:
Day 26 - 2/13/17 |
I got lectures from different professors to look at. I will be looking over these lectures over the weekend. Lectures include SQL Server and MySQL.
Day 27 - 2/14/17 |
Day 28 - 2/15/17 |
Tried out the MapReduce script on Hadoop. Instead of using Java, I used Python. I used it to sort the data that was all clustered and print out the data after it was reduced. After it is reduced the data is sorted and displayed.
Day 29 - 2/16/17 |
Made adjustments to the PowerPoint requested by Joe Oakes. I added case studies, penn state logo, and python with Hadoop.
Day 30 - 2/17/17 |
Completed Hadoop PowerPoint. I had to make Hadoop work with SQL commands but in order to do that I needed to use a different Hadoop service that is open sourced. I used Apache Hive with Hadoop to make this happen. Apache Hive is able to use their own HQL commands that are similar to SQL commands.
Week 6 total = 23 Hours
Next Week Objectives: SQLite
Key Lessons Learned/New Skills Acquired: After creating a PowerPoint on Hadoop, I have a better understanding of Hadoop.
Issues and Concerns: I had some trouble using MapReduce in Hadoop.
No comments:
Post a Comment