Delano Evangelical Free Church had its early beginnings in a large tent in Delano the 1940s, where Anders Herje of Buffalo led Bible studies. Herje’s daughter, Gladys Seashore, began a ladies Bible study in 1960. Reverend Merv Seashore began a couple’s Bible study in 1964.

In July 1965, the group felt a need for a formal church, so Rev. Seashore – who had been associated with the Evangelical Free Church of America (EFCA) – called a meeting with District Superintendent Rev. H. E. Sodergren to discuss the doctrine and beliefs of this denomination. On September 22, 1965, another meeting was held at the Ted L. Johnson home north of Delano, with Rev. Sodergren and five couples in attendance. The group voted to incorporate as the Evangelical Free Church of Delano and asked Rev. Seashore to serve as pastor.

The young church met in members' homes on Sunday evenings until October 17, 1965, when the old cafeteria annex of Delano Public School was secured as a meeting place.

On July 31, 1966, four acres of land were purchased from Herbert Levens on east Elm Street in Delano for the purpose of erecting a church building. On August 2, the group assembled at the new site before their general board meeting, offered prayers of praise and thanksgiving, and sang their theme hymn, "To God Be The Glory" by Fanny Crosby. Each person prayed that this church would never lose sight of its purpose, which was to bring lost souls to a saving knowledge of the Lord Jesus Christ with hearts full of joy, praise, and thanksgiving. The group returned to the Forest Osgood residence for the business meeting.

On June 6, 1967, after the Sunday morning service, a groundbreaking ceremony was held for the new church building. Construction started September 1. On November 22, 122 people gathered at the first Thanksgiving service in the basement of the new building. The congregation continued to meet in the basement until March 9, 1969, when the sanctuary was completed.

On May 4, 1969, the new church building was dedicated to "the glory of God the Father, to the honor of His Son, Jesus Christ, the teaching of His Word, and in the fellowship of the Holy Spirit." Dr. Arnold J. Olson, president of the EFCA, presented a message of dedication. Delano Christian Academy, which ran from 1977 to 1992, had a peak enrollment of over 90 students annually.

Rise ‘N Shine Preschool (later renamed Joyful Heart Preschool) opened in September 1993 with Lois Seeger as  director and Beven Vanasse as teacher. Beven eventually became director, followed by Deb Carlson and then Cheryl Jacobson.

In 1996, over 350 people from DEFC packed buses to participate in the Billy Graham Crusade in Minneapolis, many as counselors and choir members. DEFC has participated in numerous missionaries and activities, including  Harry and Sue Maravelas in Japan in 1992; a group of 14 youth and adults to Matamoras, Mexico, in 1997; Jeff Seeger with Operation Mobilization aboard the ship Doulos in 1998; Erin Goodwin serving as an inner-city teacher with World Impact in Chester, Pennsylvania; Lauren Kewitsch on several missionary trips; Barry Green with Timber Bay; Lisa Green with Love Inc.; and numerous others, both locally and around the world.

The church has undergone several large remodels and additions over the years, including the East Wing addition in 2000; a remodeled sanctuary in 2004; and the East Wing renovation in 2012.

In September 2023, after a prayerful and deliberative process, Delano Evangelical Free Church changed its DBA name to Redemption Hill Bible Church/An EFCA Fellowship (RHBC) to better reflect who we are as a congregation. Our "little church on the hill" serves a great Redeemer!

The church has been served by the following senior pastors:
1965–1971: Merv Seashore
1971–1976: Hugh Walker
1976–1984: Don Whipple
1984–1985: Floyd Hackett
1986–1988: Harry Maravelas
1989–2001: Dean DeVries
2001–2018: Peter Johannsen
2018–2019 Interim: Mark Bendell
2019–current: Mike Hellum