The Pharisees criticized Jesus because his disciples picked grain to eat on the sabbath, and Jesus proclaimed himself lord of the sabbath. Following Jesus is more important than following the letter of the law.
St. Paul tells us that he does not care about being judged by any human tribunal. The only judgement that counts os God's. Do we judge other people or worry how they judge us?