Fabian Lee : Software Engineer

Python: flattening exported csv relational data with pandas

December 9, 2021
Categories: Python

If your data is coming from CSV dumps of relational database tables, then you probably need to flatten the data before starting the training or analysis. It requires an understanding of the relational schema so you can specify the foreign key lookups, but from that pandas can reconstruct the relationships and produce a single flattened … Python: flattening exported csv relational data with pandas

GCP: Analyzing members of IAM role using gcloud filtering and jq

January 29, 2021
Categories: Scripting

Although the GCP console provides a nice interface for displaying which user/service account is in which IAM security role (IAM & Admin > IAM), it can be difficult to analyze using gcloud get-iam-policy because of the inner array of ‘members’ returned. However, if you use the flattening ability of gcloud, it becomes much easier to … GCP: Analyzing members of IAM role using gcloud filtering and jq