first of all - not so sure about the display name, you probably better off with CodeName.
secondly datasource filters based on one category not on many, i.e. {% CurrentDocument.Categories.FirstItem.CodeName %}
There is checkbox in repeater Filter out duplicates, make sure it is checked