How do you keep a woodpecker from pecking at your siding?

We have either a woodpecker or sapsucker that is insistent on pecking at the siding on our house. To the point that it's putting in some good sized holes. We go out and shoo it away...only to have it return 5 mins later. Anyone have a clue how to get it to leave our house alone?