Heat olive oil in a large pot over medium heat. Add chicken thighs and cook until browned on all sides, about 5 minutes. Remove chicken with a slotted spoon and set aside.