Indeed. A comet in an orbit with eccentricity of 0.99999 has a large but finite period. One with an eccentricity of 1.00001 has infinite period in that (pending a gravitational interaction with some other body) it will never return to the inner solar system.
