Orb Spectre Pool

For example: you summoned two spectres. When they die, only one remains in the Spectres Orb. And, from my observations, this ghost is often the last one summoned. So, when I enter my hideout, I see this single spectre (instead of two). Is this standard behavior or a bug?