stick to one's knitting
To concentrate on one's own tasks, affairs, area of expertise, etc., especially in order to avoid distraction, embarrassment, or other needless problems.
[A]s sportsmen I think that we should stick to our knitting and not allow economic or social conditions to interfere with the Olympic Games.