The Ornate Window is a piece of Furniture. It is possible to purchase it from the following:
Carpenter’s Shop for 900g.
Furniture Catalogue for free.
If you choose the wilderness map when you begin the game, you will start with an Ornate Window in your house.