Have you tried the WHERE condition? If it exists on the webpart then that would be your best bet. Tags are pretty flat and only have a tag group as a parent. So if you had a specific tag group you could look for only those tags but you'd have to specifically know the group you want to work with.