Open Diké is an evaluation framework and leaderboard for studying the effects of model compression on bias, fairness, ethics, and safety-related metrics.