https://quadexcel.com/wp/pyspark-filter-corrupted-records-interview-tips/