Week 14

Current Week Objectives: Hadoop

Current Week Accomplishments/Hours Worked:

Day 61 - 4/10/17 |

Configured all the settings for Hadoop and got it to work. Created a txt file and uploaded it to HDFS and also able to get the file back. Learned new hadoop linux commands.

Day 62 - 4/11/17 |

Presented my Hadoop PowerPoint presentation to a database class at Penn State Abington. This presentation took about 30mins. I presented my lecture and showed students how to access the database server I set up.

Day 63 - 4/12/17 |

Configured Hadoop so that every user on the server was able to use Hadoop. Hadoop is now working for every user and they can use Hadoop commands.

Day 64 - 4/13/17 |

Day 65 - 4/14/17 | Worked on MySQL Server on Ubuntu. MySQL is not working properly and needs to be fixed.

Week 14 total = 25 Hours

Next Week Objectives: MySQL Server.

Key Lessons Learned/New Skills Acquired: ESXi, VMware, and Linux

Issues and Concerns: Fixed Hadoop by setting the file path to the correct path in .bashrc

Week 13

Current Week Objectives: Hadoop

Current Week Accomplishments/Hours Worked:

Day 56 - 3/27/17 |

Work with a database class and talk about hadoop

Day 57 - 3/28/17 |

Added some work to my Hadoop PowerPoint

Day 58 - 3/29/17 |

Hadoop is not working on the database server. I had to remove it and re install it.

Day 59 - 3/30/17 |

Day 60 - 3/31/17 | Hadoop still is not working correctly and still needs to be fixed.

Week 13 total = 20 Hours

Next Week Objectives: Hadoop.

Key Lessons Learned/New Skills Acquired: ESXi, VMware, and Linux

Issues and Concerns: I do not know what is wrong with Hadoop. I tried to check the configuration files and formatted the hdfs.

Week 12

Current Week Objectives: Linux

Current Week Accomplishments/Hours Worked:

Day 51 - 3/20/17 |

Configure a server to run VMware. Installed Ubuntu server onto the machine.

Day 52 - 3/21/17 |

Ran into a problem where I could not download what I needed by using the server. I reinstalled ubuntu desktop version and then tried to install RenderMan again.

Day 53 - 3/22/17 |

I needed to download blender for linux to test if RenderMan is working correctly.

Day 54 - 3/23/17 |



Day 55 - 3/24/17 | Rendered an image with RenderMan on Blender. Tested how long it took to render a simple image and a complex image.



Week 12 total = 25 Hours

Next Week Objectives: Hadoop.

Key Lessons Learned/New Skills Acquired: ESXi, VMware, and Linux

Issues and Concerns: RenderMan could not be installed on VMware ubuntu server

Week 11

Current Week Objectives: Database server and SSH

Current Week Accomplishments/Hours Worked:

Day 46 - 3/20/17 |

Started the week off by setting up SSH service for users to remotely log into server. Changed the default port number in sshd_config to 5901. Set the router to allow a port number to be port forwarded so the connection can be established via ssh.

Day 47 - 3/21/17 |

Made sure SSH is working correctly and users can connect to the server. Connected via SSH by using the External MAC address and port number. Tested SSH connection with user and it is up and running.

Day 48 - 3/22/17 |

Created a document to help students with PuTTy. The document guides the students step-by-step on how to SSH into the server. Updated java and all Linux machines.

Day 49 - 3/23/17 |

Day 50 - 3/24/17 | Worked with SQL databases

Week 11 total = 25 Hours

Next Week Objectives: MySQL server.

Key Lessons Learned/New Skills Acquired: ESXi, VMware, and Linux

Issues and Concerns: I did not have any issues.

Week 10

Current Week Objectives: Setting up a server for database class

Current Week Accomplishments/Hours Worked:

Day 41 - 3/13/17 |

Day 42 - 3/14/17 |

Day 43 - 3/15/17 |

Installed ESXi on each server and set up a virtual machine environment for one server.

Day 44 - 3/16/17 |

Installed MySQL and MongoDB on the server

Day 45- 3/17/17 |

Installed Ubuntu server on the virtual machine and updated Ubuntu. Installed Java and the necessary programs for Ubuntu. I installed Hadoop onto the virtual machine today and configured it to run datanodes and nodenames. I have installed three databases on the virtual machine so far. I added a group of students from a database class so they can ssh into the database server.

Week 10 total = 15 Hours

Next Week Objectives: Try test databases on the virtual machine.

Key Lessons Learned/New Skills Acquired: ESXi, VMware, and Linux

Issues and Concerns: I did not have any issues.

Week 9 - Spring Break

Week 8

Current Week Objectives: MySQL

Current Week Accomplishments/Hours Worked:

Day 36 - 2/27/17 |

I installed MySQL on Linux and started using it to create simple databases.

Day 37 - 2/28/17 |

Started creating a PowerPoint Presentation on MySQL.

Day 38 - 3/01/17 |

Ran simple MySQL commands and tested it with the database I created.

Day 39 - 3/02/17 |

Finished up PowerPoint on MySQL and put finishing touches on it.

Day 40 - 3/03/17 |

Showed supervisor my finished PowerPoint. Got new servers for VMware and set the servers in the black box. Checked to see if all five servers were fully functional.

Week 8 total = 22 Hours

Next Week Objectives: Setting up a database server on a virtual machine.

Key Lessons Learned/New Skills Acquired: MySQL and MySQL commands

Issues and Concerns: I did not have any issues with MySQL.

Week 7

Current Week Objectives: Work with SQLite this week

Current Week Accomplishments/Hours Worked:

Day 31 - 2/20/17 |

This week I will be creating a PowerPoint presentation on SQLite. I learned how SQLite works in an android device. Researched about SQLite before starting the PowerPoint.

Day 32 - 2/21/17 |

Started to plan out all the slides and figure out what content to put on the PowerPoint.

Day 33 - 2/22/17 |

I figured out how to organize the PowerPoint and started adding everything onto the slides. I put some examples I did in linux and showed step by step guide on how to use SQLite.

Day 34 - 2/23/17 |

I wanted to create more content, so I used Python to create SQLite databases. There are many other ways to use SQLite but I chose python because this is what Joe prefers to use.

Day 35 - 2/24/17 |

I finished up the PowerPoint and showed it to my supervisor (Joe Oakes) to see if he wanted me to change anything on the PowerPoint.

Week 7 total = 22 Hours

Next Week Objectives: MySQL

Key Lessons Learned/New Skills Acquired: SQLite database/Python SQLite

Issues and Concerns: I did not have any issues with SQLite.

Week 6

Current Week Objectives: Dive deep into Hadoop and a little bit on SQLite

Current Week Accomplishments/Hours Worked:

Day 26 - 2/13/17 |

I got lectures from different professors to look at. I will be looking over these lectures over the weekend. Lectures include SQL Server and MySQL.

Day 27 - 2/14/17 |

Day 28 - 2/15/17 |

Tried out the MapReduce script on Hadoop. Instead of using Java, I used Python. I used it to sort the data that was all clustered and print out the data after it was reduced. After it is reduced the data is sorted and displayed.

Day 29 - 2/16/17 |

Made adjustments to the PowerPoint requested by Joe Oakes. I added case studies, penn state logo, and python with Hadoop.

Day 30 - 2/17/17 |

Completed Hadoop PowerPoint. I had to make Hadoop work with SQL commands but in order to do that I needed to use a different Hadoop service that is open sourced. I used Apache Hive with Hadoop to make this happen. Apache Hive is able to use their own HQL commands that are similar to SQL commands.

Week 6 total = 23 Hours

Next Week Objectives: SQLite

Key Lessons Learned/New Skills Acquired: After creating a PowerPoint on Hadoop, I have a better understanding of Hadoop.

Issues and Concerns: I had some trouble using MapReduce in Hadoop.

Week 5

Current Week Objectives: Learn and understand MySQL and Relational databases

Current Week Accomplishments/Hours Worked:

Day 21 - 2/6/17 |

I worked on MySQL and how they are connected to RDBMS. I got MySQL running on linux and was able to create databases. Created a database with primary keys and attributes that fit the database and kept practicing MySQL commands.

Day 22 - 2/7/17 |

After I got used to MySQL commands I started to use Oracle. I had to install Oracle on ubuntu and get it up and running. Oracle was a bit harder to install than MySQL. I am going to try to install Oracle after I do some researching.

Day 23 - 2/8/17 |

I had to create a Hadoop Database PowerPoint presentation that describes what Hadoop is and how it is used. I had to research the basics of Hadoop and put everything I learned onto the PowerPoint.

Day 24 - 2/9/17 |

Day 25 - 2/10/17 |

I set up a single node cluster for our localhost on Hadoop. I am still working on the Hadoop PowerPoint.

Week 5 total = 20 Hours

Next Week Objectives: Go further into MySQL

Key Lessons Learned/New Skills Acquired: I learned more about RDBMS this week.

Issues and Concerns: I had a hard time trying to figure out Oracle this week. I am going to have to find some help with this installation process.

Week 4

Current Week Objectives: Work with Cassandra and Hadoop on Linux

Current Week Accomplishments/Hours Worked:

Day 16 - 1/30/17 |

I started this week off by learning about Hadoop. This database is new to me and I have never used it before. I did some research about Hadoop and what it is used for in a database.

Day 17 - 1/31/17 |

A new task came up today with the windows 2012 server. I was able to remove the administrator password by using a recovery disk that was burned onto a usb. We did not know the password for the server before, but now we were able to get it back. We have to configure the servers for Abington Arts Center. We sat down with a group of people and talked about what they wanted on the server. We will be testing this in a Virtual Machine before doing it on the actual server.

Day 18 - 2/1/17 |

I got back to working with Hadoop and installed it on Linux while following a guide. It took awhile for me to get it up and running, but in the end I got the cluster running. I watched some videos on how Hadoop works as a database and how I can use it.

Day 19 - 2/2/17 |

Day 20 - 2/3/17 |

I sat down with Joe and talked about a database called Oracle. Oracle is a must need to know for a DBA. so I need to work on MySQL and Oracle for my next assignment. I learned about functions and classes in MySQL and how they are used. I installed MySQL on Linux today and configured all the settings for the database. I was able to use MySQL commands easily and create a table with data.

Week four total = 23 Hours

Next Week Objectives: Understand the basics of MySQL, SQLite, and Oracle

Key Lessons Learned/New Skills Acquired: I learned how to run Cassandra on a single node cluster. I also learned how to run hadoop on Linux and create a cluster.

Issues and Concerns: I was not able to run Cassandra and Hadoop on my first try. I had to kept running into errors and was not able to start either databases on Linux. I ended up figuring out what the problem was and fixed it so it would run correctly on Linux.

Week 3

Current Week Objectives: Learn a new database called Apache Cassandra

Current Week Accomplishments/Hours Worked:

Day 11 - 1/23/17 | 9AM-2PM

I spent this day learning about Apache Cassandra. I watched tutorials online that talked about the database and how it is used. I also had to create a PowerPoint presentation about Cassandra.

Day 12 - 1/24/17 | 10:00AM-2PM

Added more information about Apache Cassandra into the PowerPoint. I am currently learning about DataStax and how it is set up with Cassandra

Day 13 - 1/25/17 | 9AM-6PM

After learning about Cassandra and DataStax, I installed both of the applications on linux. Reviewing the stuff that I learned from tutorials, I was able to get it up and running. I got CQL up and running, and now I can now add data into Cassandra.

Day 14 - 1/26/17 | None

Day 15 - 1/27/17 | 9AM-3:30PM

I added some final touches onto the Cassandra PowerPoint and shared it with Joe Oakes. I also had to configure a windows 2012 server. Since we did not have the password for the machine, we had to completely reinstall the server onto the machine.

Week three total = 25 Hours

Next Week Objectives: I will try to set work on DataStax instead of terminal with Cassandra.

Key Lessons Learned/New Skills Acquired:I was able to install and run Cassandra on linux. Also I was able to learn Cassandra Query Language.

Issues and Concerns: There was a lot of setting up before using Apache Cassandra database. I needed to do research on how Cassandra worked.

Week 2

Current Week Objectives: Work on IBM Watson's Text to Speech, Speech to Text, and Conversation API

Current Week Accomplishments/Hours Worked:

Day 6 - 1/16/17 | None

Day 7 - 1/17/17 | 10:30AM-2PM

I forked IBM Watson’s github repository into my Bluemix server to look at their code. The code I looked at was for their Text to Speech, and Speech to Text application. I tried to understand how they created the application with node.js and their cloud services.

Day 8 - 1/18/17 | 8AM-2PM

Today I worked on IBM’s Conversation service and Text to Speech. I studied other codes that had Text to Speech in their applications and tried to create my own application. I ended up just taking IBM’s code and edited it around to see how they coded applications with watson services.

Day 9 - 1/19/17 | 10:30AM-2PM

I presented everything I learned on IBM Bluemix to a class. I showed them how to create  a simple application on Bluemix cloud services. This uses an SDK that is already on the cloud for developers to use. After the app is created I showed them how to add a service onto the application, i.e. the Text to Speech service. I demonstrated how IBM’s applications worked by showing them the Text to Speech and Speech to Text. I also showed them the conversation service that I worked on by myself.

Day 10 - 1/20/17 | 8AM-2PM

I started to learn how to use Cassandra Database. I watched videos on how to get started with the database. I downloaded the software onto my laptop and tried to get used to it as a beginner. I used tutorials to help me get a better understanding on Apache Cassandra.

Week two total = 23 Hours

Next Week Objectives: My main objective for next week is to get used to Apache Cassandra and start using it to manage a database.  

Key Lessons Learned/New Skills Acquired: I started learning a new database that I have never used before. I acquired more knowledge on IBM’s Bluemix cloud services.

Issues and Concerns: I had some trouble with building an application with IBM cloud services. I did not have strong knowledge of node.js, and IBM’s application was built on node.js.

Week 1

Jacky Chen


Current Week Objectives: Learn about IBM Watson services

Current Week Accomplishments/Hours Worked:

Day 1 - 1/9/17 | 8:30AM-2PM

The challenge for today is to fix a 3D Printer. The printer was missing a few parts and could not fully function.

Day 2 - 1/10/17 | 10:30AM-2PM

Followed Professor Joe to his 440W class and helped students with setting up Github accounts and made sure everyone in the class was in the right repository.

Day 3 - 1/11/17 | 9AM-2PM

Finished fixing the 3D Printer and made sure it was working before giving it back. Printed out a 3D spool holder for testing. Tested out IBM Bluemix applications, how their API works and tried to create an app. I am still learning how to use IBM Bluemix for future references since Joe’s class is going to be using it.

Day 4 - 1/12/17 | none

Day 5 - 1/13/17 | 9AM-3PM

Today I worked on IBM Watson Conversation and figured out how to create a conversation between the user and Watson. I had to create intents, entities, and a dialog in order for this to work. Intents is basically the purpose of the conversation and what you want it to talk about. Entities are like nouns that Watson can find in conversations and figure out what the user is asking. Dialog is where all the conversations happen. This is where I had to create the conversation and replies to the user and how it interacts. 

Week one total = 22 Hours

Next Week Objectives: I want to learn new kinds of database like mongoDB, Progress, Cassandra, and MySQL.  

Key Lessons Learned/New Skills Acquired: I learned how to replace/add parts to a 3D Printer, and learned some key features of IBM watson services. I have knowledge of IBM’s cloud services on watson. Some services I tried to work with are, text to speech, speech to text, and conversation.

Issues and Concerns: Some issues I had was with IBM cloud services. This was my first time using IBM services to build an app on the cloud server, so I did not understand how this was supposed to be done on IBM.