That is not a real problem. The real problem is if you did it the other way around- steering fluid in the brake system. Any other fluid in the brake system can cause parts failures. Read more about that here… http://www.cartruckinfo.com/brake-fluid-contamination.html
As for your condition, just have a power steering fluid flush service performed and you wont have anything to worry about.