Joint action is fundamental for dyadic and team sports, as we are often not able to achieve our goals alone. What other members of our team are doing or plan to do strongly affects our own action planning. The Joint Simon Effect (JSE) is a paradigm to test the mechanisms underlying joint action. The JSE is often seen as an index for the co-representation of others actions. Based on the theoretical assumption of common coding of perception and action, I will present a new framework of action control (referential coding account) assuming that phenomena like the JSE are likely due to an action discrimination problem and corresponding changes in action control settings that help to resolve this problem in specific task contexts. Evidence for referential action coding will be provided coming from real and virtual interaction scenarios. A potential relevance of referential coding for dyadic and team sports will be discussed.