• Attendance during practical classes is not compulsory, yet recommended
• You will be assigned eight individual homeworks during the semester
• There will always be at least 14 days for completing the homework assignment
• Everyone must choose their distinct topic, not later than at the second practical class
• This topic must be reported to and explicitly accepted by the tutor
• Your homework solutions must be within the topic, original, realistic, and non-trivial
• At most 95 points in total can be gained for all the homework assignments
• Solutions are awarded by up to 10 points
• Some (3) homeworks will be evaluated by randomly selected students, which is awarded by up to extra 3 * 5 points
• There will be 7 days to evaluate randomly assigned homework
• In case of any shortcomings, fewer points will be awarded appropriately
• Delay for every started day is penalized by 1 point, maximal penalty is 2 points
• Solutions can be submitted even repeatedly, only the latest version is assessed
• Once a given assignment is assessed by the tutor, it cannot be resubmitted once again
• All the homework assignments must be submitted before the intended exam date in order to be considered
• During some of the practical classes, extra 1 - 2 activity points can be acquired for solving exercises
• At least 60 of 115 points is required for the course credit to be granted
• All above 75 points (max 40 points) is transferred as bonus points to the exam

Materials: NDBI040_01_MapReduce.pdf, NDBI040_00_Introduction.pdf

Maven project: ndbi040-wordcount.zip, ndbi040-invertedindex.zip

Solution: ndbi040-invertedindex-solved.zip

Homework: MapReduce (deadline at the end of semester)

Tools: NetBeans IDE, ssh / scp (on macOS / Linux) or PuTTy / WinSCP (on Windows)

Software requirements: Java JDK 8.x or newer

Materials: NDBI040_03_RiakKV.pdf, NDBI040_03_Redis.pdf

Solution: solution_riakkv.txt, solution_redis.txt

Homework: Riak + Redis (deadline November 18th 2020 23:59 CET)

Materials: NDBI040_04_Cassandra.pdf

Solution: solution_cassandra.txt

Homework: Cassandra (deadline November 25th 2020 23:59 CET)

Materials: NDBI040_06_Neo4j.pdf, NDBI040_06_Neo4j_2.pdf

Data file: data.cypher

Maven project: ndbi040-neo4j.zip

Solution: solution_neo4j.txt, ndbi040-neo4j-solution.zip

Homework: Neo4j (deadline December 9th 2020 23:59 CET)

Tools: NetBeans IDE, ssh / scp (on macOS / Linux) or PuTTy / WinSCP (on Windows)

Software requirements: Java JDK 8.x or newer

Materials: NDBI040_08_SciDB.pdf, NDBI040_08_SetupVMWare.pdf, NDBI040_08_SetupVirtualBox.pdf

Image: SciDB 18.1 VirtualBox/VMWare image (download before practical class begins)

Data file: actors.scidb, movies.scidb, roles.scidb

Solution: solution_scidb.txt

Evaluation: SciDB Evaluation (deadline January 1st 2021 23:59 CET)

Software requirements: VirtualBox 6.x or VMWare Fusion Player 12.x / VMWare Workstation Player (16.x)

Materials: TBD

Maven project: TBD

Solution: TBD

Tools: TBD

Software requirements: TBD

• Access system, Accommodation booking, Accommodation comparator, Accommodation sharing, Agricultural production, Air rescue service, Air traffic management, Airline, Airport, Armory, Army, Artworks, Assignment submission, ATM network, Attendance system, Auction, Bakery, Bank, Bank account, Bazaar, Beekeeper, Betting shop, Beverages store, Bike sharing, Blog, Boat rental, Bookstore, Botanic garden, Brewery, Bus station, Bus tickets, Business register, Cadastre, Cafe, Canteens, Car rental, Car repair shop, Casino, Castles, Catering, Caves, Cemetery, Cinema, City tours, Classbook, Collection and disposal of waste, Collection of laws, College dorm, Computer games, Conference, Construction management, Content management system, Contract register, Cookbook, Cooking classes, Council meetings, Countries of the world, Courier service, Cowshed, Dance school, Deliveries, Desk games, Discussion forum, Doctor's office, Dog park, Dog shelter, Driving school, Drugs, Dump, Educational institution, Elections, Electronic prescriptions, Employee records, Entertainment center, Environmental center, Exhibition, Exhibition grounds, Experience donation, Fairy tales, Farmer markets, Finance manager, Financial advisory, Financial markets, Fire protection, Fishing equipment, Fitness center, Fleet, Flight ticket booking, Food bank, Food distribution, Football league, Football team, Forest kindergarten, Foster care, Gallery, Gardening colony, Gas station, Glassworks, Golf clubs, Grant agency, Grid, Hair salon, Handyman, Hardware, Health insurance, High school, Highway fees, Hiking trails, Hobby market, Hockey league, Holiday offers, Horse racing, Hospital, Hotel, Chamber of deputies, Chess database, Incinerator, Industrial zone, Insurance company, Intelligence service, Intersport arena, Job offers, Jurassic park, Kindergarten, Laboratory, Labour office, Language school, Lego, Leisure activities, Library, Log book, Logistics center, Logistics company, Logistics warehouse, Lottery, Luggage storage, Manufacturing processes, Maternity hospital, Medical reimbursement, Meeting scheduling, Menu, Metro operation, Military area, Mobile operator, Mobile phones, Model trains, Morgue, Mountain rescue service, Movies, Multinational company, Multiplex network, Museum, Music festival, Music production, Musical instruments, National parks, Nature reserve, Newspaper publishing, Non-bank loans, Nuclear power plant, Nutritional values, Online exercises, Online streaming service, Orienteering, Parking lot, Parts catalog, Patient medical card, Pawnshop, Payment cards, Personal documents, Personal trainer, Pharmacy, Photo album, Pizzeria, Plagiarism detection, Planning calendar, Police database, Political parties, Popular music, Population register, Post, Postal addresses, Poultry farming, Prison, Procurement, Project management, Property administration, Psychiatric hospital, Public greenery, Public transport, Railway network, Real estate agency, Recruitment agency, Refugee camp, Regulatory fees, Research projects, Research publications, Restaurant, Restaurant reservations, Road closures, Room reservation, Scout group, Scrapyard, Security agency, Seizures, Shared travel, Shooting range, Shopping center, Ski school, Skiing area, Social benefits, Social network, Software development, Spare parts, Sports club, Sports tournament, Stable, Statement of work, Stock exchange, Student book, Study abroad, Study materials, Study system, Subsidy programs, Summer camp, Supermarket, Sweet-shop, Swimming pool, Symphony orchestra, Tax office, Taxi service, Teahouse, Theater, Theater plays, Time tables, Tollgates, Tourism, Tourist group, Traffic accidents, Traffic control center, Train station, Transport company, Transport control, Travel agency, Trial, Truck transport, TV program, TV series, Universe, Vaccination abroad, Veterinary clinic, Video shop, Virtual tours, Visas, War conflicts, Water park, Water supply, Weapons, Weather forecast, Webhosting, Webshop, Wedding dress rental, Wholesale, Winter road cleaning, World heritage list, Zoning plan, Zoo

• Points: 10 (Riak 6, Redis 4)
• Deadline: November 18th 2020 23:59 CET
• Assignment (Riak):
  • Create a bash script that works with the Riak database over HTTP using the cURL tool
    • Insert at least 5 key / value objects for each of the 3 entity types
      • Create 3 buckets by storing objects of the same entity type in the same bucket
      • You can work with any data format (e.g. JSON, text, ...), but always add the content headers
    • Create at least 5 meaningful links, while distinguishing between 2 different tags
      • Use a separate Link header for each individual link
    • Execute 1 read request and 1 update request
    • Execute 2 queries involving link walking, one of which must include at least 1 navigation step and the other must include at least 2 navigation steps
    • Delete all created objects at the end of the script
• Requirements (Riak):
  • Create buckets based on the following naming convention: m201_login_bucketName, e.g. m201_contos_animals
  • Do not access the buckets directly inside the script, but use $ 1_bucket
  • $1 is a script parameter passed during its call, the value of parameter matches the prefix m201_login
  • Explain the meaning of your link walking queries using natural language
  • Make sure your script is executable, i.e. has executable rights assigned to it (chmod + x script.sh)
  • Your script must be reusable without failures
• Script execution (Riak):
  • The ./script.sh $BucketPrefix command executes the entire Riak script
  • $BucketPrefix represents the prefix of your buckets names, such as m201_login
• Assignment (Redis):
  • Create a script (text file) that contains a sequence of commands that work with all data types, specifically:
    • Strings: 5 insert operations (SET), 1 read operation (GET), 1 update operation (APPEND, SETRANGE, INCR, ...), 1 delete operation (DEL)
    • Lists: 5 insert operations (LPUSH, RPUSH, ...), 2 different read operations (LPOP, RPOP, LINDEX, LRANGE), 1 delete operation (LREM)
    • Sets: 5 insert operations (SADD), 2 different read operations (SISMEMBER, SUNION, SINTER, SDIFF), 1 delete operation (SREM)
    • Sorted sets: 5 insert operations (ZADD), 2 different read operations (ZRANGE, ZRANGEBYSCORE), 1 update (ZINCRBY), 1 delete operation (ZREM)
    • Hashes: 5 insert operations (HSET, HMSET), 2 different read operations (HGET, HMGET, HKEYS, HVALS, ...), 1 delete operation (HDEL)
  • Realistic keys, values, and operations are expected within the selected individual topic
  • You do not have to comment on the solution, but you can use the ECHO command for this purpose
• Requirements (Redis):
  • To debug commands, use only the database that was assigned to you at the beginning of the semester (see email with login details for the NoSQL server)
  • Do not call the SELECT command inside a text file, i.e. do not switch the active database
  • Use script parameters to specify the database number
• Script execution (Redis):
  • Execute the command cat script.txt | redis-cli -n $DatabaseNumber
  • $DatabaseNumber represents the number of the database assigned to you
• Submission:
  • script.sh: Bash script that allows you to execute all HTTP requests over the Riak database
  • script.txt: A text file with commands that work with the Redis database
• Tools:
  • Riak KV
  • Redis
• References:
  • Riak KV Documentation
  • Riak KV Search 2.0 Documentation
  • Apache Solr Query Parser Documentation
  • Redis Commands
  • Redis Documentation
  • Redis Data Types
• Server: nosql.ms.mff.cuni.cz (port 42222)
• Do not forget to execute the homework submission script

• Points: 10
• Deadline: December 2nd 2020 23:59 CET
• Assignment:
  • Create a JavaScript script with a sequence of commands working with MongoDB database
  • Explicitly create 2 collections for entities of different types
    • I.e., create them using createCollection method
  • Insert at least 5 documents into each one of them
    • These documents must be realistic, non-trivial, and with both embedded objects and arrays
    • Interlink the documents using references
    • Use both insert and save operations, each at least once
  • Express 3 update operations (do not use save operation for this purpose)
    • One without update operators
    • One with at least 2 different update operators
    • One based on the upsert mode
  • Express 5 find queries (with non-trivial selections)
    • Use at least one logical operator ($and, $or, $not)
    • Use $elemMatch operator on array fields at least once
    • Use both positive and negative projection (each at least once)
    • Use sort modifier
    • Describe the real-world meaning of all your queries in comments
  • Express 1 MapReduce query (non-trivial, i.e. not easily expressed using ordinary find operation)
    • Describe its meaning, contents of intermediate key / value pairs and the final output
    • Note that reduce function must be associative, commutative, and idempotent
• Requirements:
  • Call export LC_ALL=C in case you have difficulties in launching the mongo shell
  • Only use your own database when working on the assignment
    • Name of this database must be identical to your login name, e.g. m201_student
  • Do not switch to your database when you are inside your script
    • I.e. do not execute USE nor db.getSiblingDB('database') commands
    • Specify the intended database outside your script using command line options (see below)
  • Print the output of your queries (find operations)
    • Use db.collection.find().forEach(printjson); approach for this purpose
  • Print the output of your MapReduce job using out: { inline: 1 } option
    • I.e. do not redirect the output into a standalone collection
• Submission:
  • script.js: JavaScript script with MongoDB database commands
• Execution:
  • Execute the following shell command: mongo $DatabaseName $ScriptFile
  • $DatabaseName is a name of database that should be used, e.g. m201_student
  • $ScriptFile is a file with MongoDB queries to be executed, i.e. script.js
• Tools:
  • MongoDB 3.2.9 (installed on the NoSQL server)
• References:
  • The MongoDB 3.2 Manual
• Server: nosql.ms.mff.cuni.cz (port 42222)
• Do not forget to execute the homework submission script

• Points: 10
• Deadline: December 16th 2020 23:59 CET
• Assignment:
  • Create a script (ordinary text file) that consist of a sequence of SQL/JSON statements, i.e., illustrate work with relational and document data model
  • Define a schema for 2 tables for entities of different types
    • Define at least one column for each of the following data types: json, jsonb
    • Define reference integrity constraint between tables
  • Insert at least 5 rows into each of your tables
  • Show that you know how to use operators and functions working with json/jsonb data types
    • Involve at least 1x each of the following json/jsonb operators: ->, ->>, #>, #>>
    • Use chaining of operators -> a ->> appropriately
    • Use at least 2 of the following jsonb operators: @>, <@, ?, ?|, ?&
  • Express at least 4 update statements
    • Do not replace whole document, i.e., use appropriate operators, e.g., ||, -, #-
    • At least 1x use each of the following functions: jsonb_set, jsonb_insert
    • At least 1x perform update statement over a nested document
    • At least 1x perform update statement over an array
  • Express at least 4 queries
    • Use WHERE, GROUP BY, HAVING and ORDER BYclauses, all of them at least once
    • At least 1x perform nested query
    • At least 2x represent a result of a query by jsonb data type while using different jsonb creation function, e.g., to_json[b], array_to_json, row_to_json or json[b]_object
    • At least 1x use type casting
    • At least 1x exploit aggregate function
    • Use aliasing (AS) appropriately
  • Create at least 1 index over column having jsonb type
• Requirements:
  • Only use your own database and default schema when working on the assignment
    • Name of this database must be identical to your login name, e.g. m201_student
    • Name of the default schema is "public"
    • Do not create (any) schema nor use any other than "public" in your script
• Submission:
  • script.sql: Text file with SQL/JSON statements
• Execution
  • Execute the following shell command to evaluate the whole script: psql -d $DatabaseName -f $ScriptFile
  • $DatabaseName is a name of existing database that should be used, e.g. m201_student
  • $ScriptFile is a file with SQL/JSON queries to be executed, i.e. script.sql
• Tools:
  • PostgreSQL 11.10 (installed on the NoSQL server)
• References:
  • JSON Types
  • JSON Functions and Operators
  • Aggregate Functions
• Server: nosql.ms.mff.cuni.cz (port 42222)
• Do not forget to execute the homework submission script

• Points: 10
• Deadline: December 30th 2020 23:59 CET
• Assignment:
  • Create a bash script that works with the Riak database over HTTP using the cURL tool
  • Define mappings for 1 index where you should index all the documents (of the same entity type)
  • To every created index, index (insert) at least 10 non-trivial documents
    • At least 1 property must contain a textual sentence to be used for full text search
    • At least 1 property must be a nested document
    • At least 1 property must be an array
    • All the values must be inserted by single bulk call
  • Express at least 4 compound queries, while use at least 4 different clauses: bool, boosting, constant_score, dis_max, function_score
  • Express at least 1 aggregation query
  • At the end of your script, do not forget to delete all the created indices
• Requirements:
  • Create indices based on the following naming convention: m201_login_index, i.e. m201_student_animals
  • Do not access the buckets directly inside the script, but use $1_index
  • $1 is a script parameter passed during its call, the value of parameter matches the prefix m201_login
  • Describe the real-world meaning of all your queries in echo "text" comments and explain why you use particular clauses
  • Make sure your script is executable, i.e. has executable rights assigned to it (chmod +x script.sh)
  • Your script must be reusable without failures
• Submission:
  • script.sh Bash script that allows you to execute all HTTP requests over the Elasticsearch
  • data.txt: Data definition indexable by bulk call
• Execution:
  • Execute the following shell command: ./script.sh $IndexPrefix
  • $IndexPrefix represents the prefix of your indices names, such as m201_login
• Tools:
  • Elasticsearch 7.10 (installed on the NoSQL server)
• References:
  • Index API
  • Mapping
  • Mapping Types
  • Document API
  • Query DSL
  • Aggregations
• Server: nosql.ms.mff.cuni.cz (port 42222)
• Do not forget to execute the homework submission script