FIT2004 课业解析

  • May 15, 2020

欢迎使用 wangEditor 富文本编题意:从给定的歌词文件中,根据特征词查找歌曲ID解析:类预处理:按特征词字典升序整理歌词;整理:按特征词字典升序把歌曲ID统计在同一行,按升序排列;根据游戏提出的特征词查找相应ID,未找到则打印Not found涉及知识点:字符串处理,排序与查找更多可加微信撩骚FIT2004 S2/2019: Assignment 1Nathan CompanezDEADLINE: Friday 23th August 2019 23:55:00 AESTLATE SUBMISSION PENALTY: 10% penalty per day. Submissions more than 7 days late are generally not accepted. The number of days late is rounded up, e.g. 5 hours late means 1 day late, 27 hours late is 2 days late. For special consideration, please complete and send the in-semester special consideration form with appropriate supporting document before the deadline to [email protected] CRITERIA: It is required that you implement this exercise strictly using Python programming language (version should not be earlier than 3.5). This practical work will be marked on the time complexity, space complexity and functionality of your program.Your program will be tested using automated test scripts. It is therefore critically important that you name your files and functions as specified in this document. If you do not, it will make your submission difficult to mark, and you will be penalised.SUBMISSION REQUIREMENT: You will submit a zipped file (named, e.g. if your student id is XXXX, the name of zipped file must be It should contain a single python file,, and a single pdf file, description.pdfPLAGIARISM: The assignments will be checked for plagiarism using an advanced plagiarism detector. Last year, many students were detected by the plagiarism detector and almost all got zero mark for the assignment and, as a result, many failed the unit. “Helping” others is NOT ACCEPTED. Please do not share your solutions partially or/and completely to others. If someone asks you for help, ask them to visit us during consultation hours for help.StoryNathan and his friends have always enjoyed playing games. Well, that might not be completely true. Nathan and his friends have always enjoyed winning games. The glory of victory, the thrill of achievement – these are the important things. These are what really matter. For some people, the point of a game isn’t to win, but rather, to have a good time. Good company, good fun, and a relaxed atmosphere. These people do not get invited to play games with Nathan and his friends. Every so often, Nathan and his friends have a game night. These are cutthroat, vicious affairs, with every player doing their best to win (short of cheating). Professional coaches, obscure rules, loopholes, you name it. Nathan has never won one of these game nights. But this is about to change, because this year, Nathan has you. With the power of algorithms, you will help him destroy his competition and finally claim the victory that he has craved for so long.The first game night: The Song GameBefore the first game night of semester, Nathan finds out through devious and underhanded means, that the game is going to be the Song Game. The game is played as follows:1. A word is chosen. This word is called the target word.2. Each player must think of as many songs which contain the target word as possible.3. Players then taking turns singing a line from a song which contains the target wordand has not been sung by another player.4. Players that cannot do so are out, with the last player remaining being the winner.Nathan has asked for your help. You have agreed to write an algorithm for him which allows the user to quickly look up songs which contain specific words. A detailed breakdown of what you need to do is given in the tasks below.Algorithm Descriptions (2 mark)For each of the three tasks, you must also write a brief description of your algorithm. The total length should be no more than 800 words. These three descriptions will be submitted in the pdf file descriptions.pdf mentioned in the “Submission Requirement” section. These descriptions should explain the steps your algorithm takes to solve the problem, and the complexity of each step. Please try to keep these descriptions at a fairly high level, talk about your data structures and algorithms, not individual variables or lines of code.1 Sorting and Collating (12 marks)You start with a file containing lyrics from many songs. This is not in a useful format for quickly looking up individual words, so you will need to preprocess it first. You must write a function process(filename) which takes as input a string of a filename (the format of this file is specified in 1.1). The function will sort the words of all the songs, and output these sorted words to another file.1.1 InputFor this task, we define a word to be a sequence of lowercase English characters (a-z). A word does not contain any kind of punctuation or other symbols. Song lyrics are a sequence of words separated by spaces. Each line of the input file will start with a non-negative integer, which is the song ID. This number is followed by a colon, then the song lyrics on a single line. Since song lyrics can be quite long, each line of the file may also be quite long.Example:1234:an example song222222:a second song0:a example an example1.2 Outputprocess will write output to a file named “sorted_words.txt” (which it will create). This file will consist of T lines, where T is the total number of words over all songs in the input file. Each line will start with a word, then a colon, and then the song ID of the song that word belongs to. The order of the lines depends on the words. If the word in line x is lexicographically less than the word in line y, then x will appear before y in sorted_words.txt. If two line have the same word, then the one with lower song ID will appear first.Example:a:0a:222222an:0an:1234example:0example:0example:1234second:222222song:1234song:2222221.3 Complexityprocess must run in O(TM) time, where• T is the total number of words over all songs in the input file• M is the length of the longest word2 Collating (8 marks)Now that You have the words in sorted order, the next task is to collect information about each word. When you look up a particular word, you want the song IDs of the songs which contain it to be easily accessible. To do this, you will write a function collate(filename) which takes as input a string of a file name (the format of this file is specified in 1.2). The function will collect the song IDs of each word, and output the unique words together with their song IDs to another file.2.1 InputThe input to this task is a file produced by the process function from task 1.2.2 Outputcollate will write output to a file named “collated_ids.txt” (which it will create). This file will consist of U lines, where U is the number of unique words in the input file. Each line will start with a word, then a colon, and then all the song IDs of the songs which contain that word (separated by spaces). The song IDs in each line will appear in ascending order. The order of the lines depends on the words. If the word in line x is lexicographically less than the word in line y, then x will appear before y in collated_ids.txt.Example:a:0 222222an:0 1234example:0 1234second:222222song:1234 2222222.3 Complexitycollate must run in O(TM) time, where• T is the total number of words over all songs in the input file• M is the length of the longest word3 Lookup (8 marks)You are finally ready to play the song game. You will be given a number of queries, each one consisting of a single word. For each query, you need to determine which songs contain that word. You will write a function lookup(collated_file, query_file) which takes as input two filenames, and for each word in query_file determines the songs which contain that word.3.1 InputThe input to this task consists of two files. The first, collated_file, will be the same format as a file produced by the collate function from task 2. The second file, query_file contains words, each one on a separate line. Note that these words may not be in sorted order.3.2 Outputlookup will write output to a file named “song_ids.txt”. This file will contain the same number of lines as query_file. If the word on line i of query_file appears in at least one song, then line i of “song_ids.txt” will contain the song IDs (in ascending order, separated by spaces) that contain that word. If the word does not appear in any song, then the corresponding output line should be the string “Not found”.Example:If the query_file wasaexamplethe”song_ids.txt” should contain0 2222220 1234Not found3.3 Complexitylookup must run in O(q × Mlog(U) + P), where• q is the number of words in query_file• M is the length of the longest word in any song• U is the number of lines in collated_file• P is the total number of IDs in the outputYou may assume that the time complexity of reading the input file is small compared to the complexity of lookup as a whole. In other words, do not consider the time to read the input when determining the complexity of lookupWarningFor all assignments in this unit, you may not use python dictionaries or sets. This is because the complexity requirements are all deterministic worst case requirements, and dictionaries/sets are based on hash tables, for which it is difficult to determine the deterministic worst case behaviour.Please ensure that you carefully check the complexity of each inbuilt python function and data structure that you use, as many of them make the complexities of your algorithms worse.Common examples which cause students to lose marks are list slicing, inserting or deleting elements in a list in the middle or front of a list (linear time), using the in keyword to check for membership of an iterable (linear time), or building a string using repeated concatenation of characters.These are just a few examples, so be careful. Remember, you are responsible for the complexity of every line of code you write!