Does this make me officially a writer for CoH2.org?
To watch a replay, you have to download it, put it in your replay folder, and then load it up in Company of Heroes 2.
To download a replay, click on the download button, either in the list of replays or while looking at the replay’s page.

Download button in the list of replays highlighted

Download button on the replay page highlighted
Place your replay in the following folder:
My Documents\my games\Company of Heroes 2\playback
To save time you may wish to make a shortcut to this folder so that you can save downloaded replays directly to it.
Finally, load up Company of Heroes, click on the Replays button, and find the replay you downloaded.

Replays button in the game menu highlighted
Don't forget to Honor replays that you enjoy watching! Honoring replays helps the community find the best replays and it encourages players to post their best games.
Replays for previous versions of the game will not run correctly, so make sure you check the version number before downloading.