u/OutsideSignal4194 wrote (the comment Michael replied to):
Do you have any plans to have some sort of third party audit the outcomes you do have on your blog for example or anything that is being actively promoted or advertised? I am sure there are outcomes that should be verified by a third party like how many end up at FAANG companies,
u/michaelnovati replied · ★ FEATURED
We don't right now because auditing requires a framework of rules to check against first. But you can get any data audited that has rules and the auditors just make sure you follow the process! And believe it or not, CIRR data is audited AFTER the fact, not before (which is one of the problems).
Believe it or not but CIRR doesn't even say how salary information needs to be collected whatsoever, so just asking someone and taking their word for it can be considered the golden source of truth!
We collect detailed placement data for every single placement and detailed compensation info following an internal process, and some day we could potential turn that into something auditable to make sure we don't make any mistakes in collecting the data. Right now just have a crazy strict authorization and verification process to touch this data to make sure every pixel is correct, but we could probably have a more looser process that is easier to maintain and rely on auditing to check it's being done properly.