When should I create a new project?

You should create a new project for each billable task. Some clients will have multiple projects.

Should each team member use their own project?

Multiple team members can use the same project.