<aside> 🤖 This code is a Scrapy spider designed to extract scholarship information from various websites to then upload the data to a Google Spreadsheet, while also adding events to the user's Google Calendar for scholarship deadlines.
</aside>
Screen Recording 2024-08-02 at 6.24.03 PM.mov
<aside> 🔑 Swipe RIGHT to remove Swipe LEFT to add to the list
</aside>
Data Extraction: The spider scrapes scholarship information from several distinct websites, including Fastweb, Scholarships.com, and CollegeBoard. Each website has a unique scraping method to extract pertinent information such as scholarship details, deadlines, and website links.
Data Storage: The extracted data is stored in a list named data, which comprises dictionaries containing the website name, website link, and scholarship details.
User Authentication: The spider authenticates the user using Google's OAuth 2.0 protocol. The user is prompted to enter their Google account credentials, which are then used to obtain a token for accessing the Google Sheets API.
Data Upload: The spider uploads the extracted data to a specified Google Spreadsheet, specifically to a sheet named "Sheet1".
Calendar Integration: The spider adds events to the user's Google Calendar for the scholarship deadlines after they swipe left using the Google Calendar API. The user is again prompted to authenticate with their Google account credentials for this purpose.
This spider provides an automated solution for gathering scholarship information, organizing it in a Google Spreadsheet, and ensuring users are reminded of deadlines through Google Calendar events.
