Category Archives: etl

How do I unlock blocking queries in Amazon Redshift?

Posted on August 12, 2019 by mx

I noticed my dimension table was stuck when I query it for etl job and the truncate statement fails to return. “Locking is a protection mechanism that controls how many sessions can access a table at the same time and … Continue reading →

Posted in etl | Leave a comment

mysql tricks: do instant table swap to mitigate mysql deadlock error.

Posted on May 19, 2017 by mx

mysql tricks: do instant table swap to mitigate mysql deadlock error. Continue reading →

Posted in etl, relational databases, Uncategorized | Tagged , , , , | Leave a comment

Best Practices for Micro-Batch Loading on Amazon Redshift

Posted on November 10, 2016 by mx

Best Practices for Micro-Batch Loading on Amazon Redshift Article by AWS blog I work with Redshift everyday now at Amazon. It’s very useful big data warehouse tool. Here’s a blog post about loading data into it. It’s very s3 dependent … Continue reading →

Posted in big data, data wrangling, etl | Tagged , , , | Leave a comment