Yes, the MAX4888B is designed for DC-coupled applications.
MAX4888B vs. MAX4888C: The MAX4888B is just an analog switch with no internal biasing. The MAX4888C is an analog switch with internal biasing for use with AC-coupled signal paths. The data sheet mentions AC-coupling for the “C” version in several places. Even though it does not state that the “B” version is meant to be DC-coupled, it is assumed. The MAX4888B really is intended for DC-coupled applications.