In competitive electricity markets, the vertically integrated utilities that were responsible for ensuring system reliability in their own service territories, or groups of territories, often cease to exist. Typically, the burden falls to an independent system operator (ISO) to ensure that enough ancillary services (AS) are available for safe, stable, and reliable operation of the grid, typically defined, in part, as compliance with officially approved engineering specifications for minimum levels of AS. In order to characterize the behavior of market participants (generators, retailers, and an ISO) in a competitive electricity market with reliability requirements, we model a spot market for electricity and futures markets for both electricity and AS. By assuming that each participant seeks to maximize its expected utility of wealth and that all markets clear, we solve for the optimal quantities of electricity and AS traded in each market by all participants, as well as the corresponding market-clearing prices. We show that futures prices for both electricity and AS depend on expectations of the spot price, statistical aspects of system demand, and production cost parameters. More important, our model captures the fact that electricity and AS are substitute products for the generators, implying that anticipated changes in the spot market will affect the equilibrium futures positions of both electricity and AS. We apply our model to the California electricity and AS markets to test its viability.