Python 3 Micro Instance on Aws

Assignment Task

Task

1. Do this on t2.micro instance on AWS

2. Install Python 3 and create a script (gen.py) that can generate a 1GB file.

• o The file should meet the following criteria:
• § Be at least 1GB in size
• § Have four columns [id, integer1, string1, string2].
• § Id: should be auto-incrementing [1…n]
• § Integer1 should be randomly assigned as numbers 1-10
• § String1 should be random characters of length 1-32
• § String2 should also be random characters of length 1-32
• § The output file should have a header row, use a comma as a delimiter and be called “source.csv”
• o Answer the following questions:
• § How many rows did you generate? Why?
• § What is the content of the last row? How can you easily find this?
• § What is the distribution of integer1? Which is most common?
• · Which row has the most vowels (considering Columns String1 and String2)?
• § How large is a compressed (gzip) version of this file?
• § How long did the compression process take?
• 3. Create another script (called split.py) that splits the 1GB file.
• o Using the generated file (“source.csv.gz”), split the file into 10 new files where the resulting filenames are part-[Integer1].csv.gz
• o How long does this process take?
• 4. Upload the data to S3
• o Please provide a link to download one of the 10 files ex: 3.csv.gz
• 5. [Bonus] What approach would you take if you needed to split 32TB of data

This IT Assignment has been solved by our IT Experts at TVAssignmentHelp. Our Assignment Writing Experts are efficient to provide a fresh solution to this question. We are serving more than 10000+Students in Australia, UK & US by helping them to score HD in their academics. Our Experts are well trained to follow all marking rubrics & referencing style.

Be it a used or new solution, the quality of the work submitted by our assignment Experts remains unhampered. You may continue to expect the same or even better quality with the used and new assignment solution files respectively. There’s one thing to be noticed that you could choose one between the two and acquire an HD either way. You could choose new assignment solution file to get yourself an exclusive, plagiarism (with free Turnitin file), expert quality assignment or order an old solution file that was considered worthy of the highest distinction.