Update limits implementation to correctly deal with empty and negative values.

[owais]

According to the spec

Empty value is treated as infinity. Non-integer and negative values are invalid.

We should ensure out limits implementation takes this into account.