The origins of Leicester City, often referred to as The Foxes, dates back to 1884. Originally named Leicester Fosse because their first playing ground was next to the Fosse Road, the club joined the Football Association in 1890. They then turned professional in 1891 and entered The Football League two years later (source).
This was not always smooth sailing for them though. In fact, they faced relegation into Division Two only a few seasons after joining. The team bounced between divisions over these early years resulting in uncertainty and financial difficulty.
Noteworthy early players include Arthur Chandler who remains the club's top scorer with 273 goals (source)