Practice web RPA workflow 2 - IMDB writers

david

Objective: For the top 10 movies in IMDB, collect the writers name(s), and output as an Excel.

The website to check the top movies is: https://www.imdb.com/search/title/?groups=top_100&sort=user_rating,desc

Expected Excel outcome: on each row - the name of the movie and ONE writer per line. If there are more than 1 writer per movie, each writer should appear on its own row.

e.g:
...
The Godfather | Mario Puzo
The Godfather | Francis Ford Coppola
The Dark Knight | Jonathan Nolan
...

david

@Nitish @Ashutosh

Nitish

Hi @david

We have started worked on this wrkflow. If case we need anything, we'll reach out to you.

Nitish

Hi @david ,

We are working on this wrkflow and extracted IMDb movies along with all the writers associated with each movie, storing the results in Excel with action 'Export Workflow Data to File'.

When saving the data, the action “Export Workflow Data to File” generates separate files. For example, each movie name with its writers is saved in individual files, and when the loop runs 10 times, it creates 10 different files.

We tried using ‘Convert JSON to CSV file’ as well, but it returned the same data.

We’d like to know if there’s a way to combine all this data into a single Excel file.

Could you please take a look at the wrkflow : https://account.wrk.com/designer/?wrkflow_id=49902

david

After reviewing the wrkflow:

When in a loop - the Export to File will create a new file every time it is called within the loop. The Export to File will only "join" and gather all data when it is in a "divide" situation. In this case - you need to save the data temporarily somewhere e.g: Data Store, then do the export to Excel after you have exited the loop.
You do not need to open a browser session at every iteration. You can just navigate to the URL and perform your action within the same browser session. It is way more economical.
It is good practice to close a browser session when you are done.

Nitish

Hi @david ,

Please share yesterday recording.

Nitish

Hi @david ,

We have completed the work on this wrkflow. The data is now successfully fetched, processed, temporarily stored in the datastore, and then cleaned up after use. We have also tested the workflow using a single browser session.

We also tried running the wrkflow with other settings, which produced a different output, but that version has been removed. Below is the screen shot of that one. This exports a comma separated list of writers

Please have a look at the updated wrkflow here: https://account.wrk.com/designer/?wrkflow_id=50100

david

You managed to get the writers without navigating to each individual movie page 🤣 The practice aimed at getting you to use RPA to navigate around. That being said, the Wrkflow is designed and worked perfectly. Well done.