Not a bad start, but having to constantly fight against opposing arrows is just an added slowdown and adds nothing to gameplay other than annoyance and slower advancement.
You need to make interactable objects somehow highlight or give some indication that they are interactable. Otherwise it goes from the player trying to solve your puzzles to randomly clicking everywhere to see what he/she can interact with.