We have received reports of required application compliance policies marking devices as non-compliant after auto-updating to AirWatch Agent 5.4. New enrollments do not appear to be affected.
If a user is updating his apps (the apps are greyed out or the progress bar is slowly increasing) and AirWatch requests an application list sample from the device (manually or through the automatic AirWatch scheduler), any applications that are still in progress of updating will not be listed in the application list sample. This will mark the application as "not installed" in AirWatch, which can trigger compliance policies that depend on specific apps being installed. The risk for this occurring will increase for users with large numbers of large application updates while on a poor network, or if the iOS device encounters an issue where the application updates are paused (such as if the user leaves the Wi-Fi connection during updates).
Our recommendation to administrators who are leveraging strict compliance policies that rely on the application list sample of devices is to take this edge case into account and to update the compliance policy to increase the time between a device being listed as non-compliant and when the device is enterprise wiped, or any other significant action is taken.
We have informed Apple of the issue and this article will be updated once we confirm a resolution in iOS. If you have Apple Care Support you may wish to reach out directly to Apple to learn more details around the status of this issue.