ETL to QE, Update 10, Time Queries
Date: 2023-10-16
See Discord Binding for project context
Time Queries
Many of the Queries I do inside DiscordAnalytics.py take over a minute to perform on my 26 million message dataset running on dual core sever with 8Gb ram. I wanted to know which queries were taking the longest and needed to be optimized so within the DataAnalytics class I created an additional attribute that contained a DataFrame to store how long each query took in seconds.