To backup inconsistent databases, run a consistency check on the farm. (ID 3106)

You could verify how much data DPM is trying to back up by running the following command in an Administrator command prompt on the protected server:
C:\Windows\System32\wbadmin.exe start backup -allcritical -backuptarget:%1
(Just say "No" when it prompts to start the backup operation.)