He saw limited playing time behind Eagles starting quarterback Norm Snead. In 1966 Concannon led the Eagles to several early December wins that allowed Philadelphia to finish the season with a 9-5 record and a tie for second place in the Eastern Conference of the NFL. Jack played with Philadelphia from 1964 through 1966 and then was traded to the Chicago Bears for tight endMike Ditka. He played for five years with the Bears. In 1967, Concannon rushed for a career-high 279 yards, but he was injured during the 1968 season and never put up significant rushing numbers again. His most productive season as a passer came in 1970, when he set career marks with 385 attempts, 194 completions, 2130 yards, and 16 TDs; as well as throwing 18 interceptions. His performance quickly dropped off after that, as he was limited to just three games due to an injury in 1971, which would also be his last season with the Bears. He was traded to the Dallas Cowboys, and played on the taxi squad for two seasons. He was picked up by the Green Bay Packers in 1974 and ended his career as a backup in 1975 with the Detroit Lions.
During his NFL career, Concannon became a partner in a restaurant and had cameo appearances in the original MASH movie and in Brian's Song, the story of Chicago Bears teammates Brian Piccolo and Gale Sayers. Concannon died of a heart attack at age 62.