Fewer real estate firms, agents run afoul of rules