How can we create our own evaluation tasks with Appraise?

Hi,
I wonder if we can create our own evaluation tasks with Appraise? Following the ReadMe, I will only have a example homepage for WMT2016, but I will not be able to access the link to add a user nor can I create a new evaluation task. 
I wonder if there is a way that I can create my own evaluation task with Appraise. Thanks. 
