Showing posts with label Data. Show all posts
Showing posts with label Data. Show all posts

The PaCT: A Way for Teachers to Gain a Better Understanding of Student Progress (Part 1: Math)

Today I had the pleasure of attending a course to grow my knowledge of PaCT and of the relationship between this tool and the Math Learning Progression Framework. (Here is the Website, if you wanted to have a look for yourself).

One needs to have a reasonable understanding of the Math Learning Progression Framework before you can start using the PaCT. Therefore we started the day with a deep dive into the Math Progressions, where these came from and how these can be used to strengthen teacher practice. 


In order to teach an effective math programme one must have a good knowledge of math to begin with. The level that teachers need to be working at in order to teach successfully is Level Four. (Unfortunately, this does not seem to be the case for most educators)

It is important to note that the website above provides guides, videos and PLD activities that are used nationally to help support a coherent message of what achievement in Numeracy looks like and also what the PaCT supports.
Currently there are are twenty high user schools of PACT and MOE can point schools in their direction to provide support based on region.

The possible elephant in the room is... The Numeracy Progression Framework. This is the content knowledge that teachers need to know to be able to teach math. Teachers confident in their math knowledge should be able to identify what students are doing in math and therefore where they are sitting in terms of the Learning Progression Framework (LPF). Programmes like DIMIC and YouCubed provide a pedagogy around the teaching of math rather than math content.


Looking at the Learning Progression Framework:

There are eight aspects of knowledge: The reasons behind the eight explains each aspect and where the Number Framework sits.
(Side note: Fractions and proportions are integrated throughout the framework. We have not “lost” this in the final aspects.)


Looking at Sign Posts:

Sign posts for learning progress are informed by number framework. Placement of the signposts shows you comparatively when new aspects could be introduced when comparing to others. All placements have been generated by NZCER research so are evidence based. LFP were designed so that all of the meaning would be visible in the examples as words can be interpretive. (The design development in more depth). The illustrations give an example of what the description is there is a big focus on teachers going through the illustrations. TEACHERS MUST read the annotation to understand the illustration. Not just focus on the question. 

The number of signposts per aspect relates to the complexity of learning the aspect and the number of illustrations is determined by the minimum illustrations required to explain that aspect at that sign post.  For example: multiplicative thinking has 9 signposts because NZCER found them to be significantly different.

It is crucial to make sure a teacher understands that it is not just one thing that determines each sign post but rather the range of aspects of a learner at each point.
Teaching teachers to identify what each aspect is and what it looks like in student work. Then from this how to plan for each aspect to be taught every term rather than in siloed subjects - we know teaching this way does not work to build math knowledge.
A question that teachers could be asking is:

How much progress should I be thinking that my students will make this year?

These sign posts are not to be used as examples to teach through or as an assessment. They are used to capture the key things that go on as a student progresses in math. 

NZ math - resource finder - in the future there will be a way to find resources by addressing the gap between signposts under using LPF Aspects. 


An interesting note is that the Framework has removed “Stage 3” because it is a pedagogical step rather than a cognitive one. Students can move from materials to number properties without having gone through the “imaging” phase.

From the site itself:

It is important that students develop their knowledge and skills across all aspects of the mathematics framework so that they can use mathematics and statistics confidently, within the mathematics and statistics learning area, in other learning areas, and in their everyday lives.

The strong connections that exist among the mathematics aspects mean that lack of exposure to all the big ideas in mathematics and statistics can restrict students’ progress. The framework helps you to think about the breadth of your mathematics and statistics programme and provides a way to check that you are planning for a comprehensive coverage of the learning area.


This will only work if teachers programme has the potential to cover multiple aspects. Long term plans crucial to tie aspects into what is happening in other curriculum areas. Look at depth of the signpost. Multi problem rich tasks to support signpost learning. 


The whole idea is around noticing what you have observed students doing. Do not think that you need to Gloss or Numpa, (these tests have always been to improve teacher understanding of Framework - now become overused assessment tool - STOP IT!)   all students to be able to identify where they are achieving. Trust your judgement and provide examples of what the student has done in class - you could also get students to show you a problem as evidence if that was required. Student blogs are a great example of where students can provide evidence of where they are at in math. 



Moving to PaCT - The Tracking Tool: 
(School’s need to log in to PACT and set account if they do not have one. It uses education sector logon.)
Consistency comes from using the same illustrations rather than adapting and making your own. This creates dependable information that can be used by everyone. 

This tool goes from school to school tracking student progress - it is an online digital tracking tool. So let’s get a shared understanding of what each sign post looks like with a group of students. As a Cluster this could be perfect PD - we could create a shared understand of math progress. 

When we are making judgements with the tool we are looking at what students understand independently. Focus is on un-scaffolded understanding.
E.g. starting a session with a class problem and then seeing which students can move past this on their own, which need support and which need a different problem entirely. 
DO NOT only use this tool for a few students! It is for a whole class. There are probably only 2 sign posts that your class sits between. (Side note: we don’t group as a result of sign posting, this is not the message we are giving here).  
We aren’t looking for a perfect fit we are looking at the sign post above and below (to rule them out) and see where they fit best. 
At every point it is what student CAN do. Not what they are beginning to do. 

In October there will be no time windows for when data can be added it can be added authentically at the time it occurs in practise. 

Information on using PaCT reports can be found here. 
This is an example of a report for a class. You can also get a similar looking graph per student. 
You can remove the curriculum trajectory so that the comparison is what typical students on average are achieving (the grey highlighted line). 

The report allows you to add matched student data to the report from students within the school or previous classes. 

The tool also allows the data to be collected at a cluster level. This could have great positive implications for our cluster to help identify pockets of promise. 

There will be pdf's added within the next few months to give more information on how the reports can be used. 


Final thoughts for the day:
If we can empower teachers to use this tool to inform their practice it should have a HUGE positive implication for Math Data at a WF level. 
Teachers who use this tool confidently would have better content knowledge and understanding what next steps are, meaning better focused teaching. 
Another implication could be less testing, it is not needed therefore students and teachers may take WF testing more seriously.
More evidence of the success of implementing this tool can be found here in a case study 






Feedback from Woolf Fisher - Summer Learning Journey

As always it is so great to have the opportunity to break down and understand our data with the team from Woolf Fisher. This time we were discussing our Summer Learning Journey Data along side the cumulative data from the beginning of our Manaiakalani journey. 

It is important to note that this was Uru Mānuka's first time participating in the Summer Learning Journey and so as expected our data does look different from Manaiakalani's. Some of the finer details of Manaiakalani's data will help us greatly in the future. Things like what activities our students are more interested in completing and how many blog posts need to be made to make progress or learning shift. 

The Summer Learning Journey focus is on Reading and Writing. The assessment used to analyse the data is the PAT Reading and e-asTTle Writing scores. Students are given choice in the number of tasks they complete and also get credit for commenting on others work. They also receive personal feedback on every blog post from a team of adults working out of Auckland University. The below table is from Manaiakalani's SLJ showing the success of the programme. 

It is interesting to note that students who don't blog over summer can lose up to 5 months of learning in Writing. The fact that students who participated did not experience the Summer Learning Dip it a huge success and the evidence that they actually made progress over the school break is an even bigger one! 

Below is data collected on student engagement based on activity type: 

It is interesting to see that our students completed the task that was to express their opinion the most. 

The other relevant data was evidence on how frequent blog posts needed to be to show progress. 

The difference between students blogging once a week and twice a week is huge. The activities are only 10-15minutes in length. If we can somehow get our parents on board and get students blogging twice a week  (at minimum) over the breaks we will see a significant level of progress in both Reading and Writing for our learners. 
This also lead us to asking questions around how habitual this is currently for our learners - are they blogging twice a week at the moment? If they are is it more likely that this behaviour will continue throughout the break? These are some areas that need some looking into. 

I am excited to see what each school will do in reflection to this data. I feel that our cluster is experiencing huge success in our connection, communication and coherence. More heads are better than one, and now we have strong evidence to tell us what exactly improves student progress over the break! 



x

Next steps from Data 2018

Well... this year has taken off and we are already in week 7! It has been a while since my last post and I apologise. We were super fortunate to have the Woolf Fischer Research Team down to present our data from 2018 and give us an indication of areas we are doing well in and others that we need to improve in. WFRT also gave us some areas of inquiry for this year - which I will talk about below. 

Pockets of Promise: 

Writing
Students from year 0-1 are making accelerated progress and are getting close to meeting the National Norms after their first year! Well done Junior Teachers!

On average all students in writing made more than norm progress.
In three schools students ended the year with achievement higher than national norm.

Over two years (2016-2017) all students are still making more than expected progress in Writing.
On average our boys are making more progress than our girls in Writing.
All ethnicities made accelerated progress.

Future Focus/ Next steps:

Reading
50/50 split between students making accelerated progress and low achievement in Reading.
We are still making progress in Reading, just not enough progress - not the same amount as the National Norm. This is an area to look into as it is unusual to have higher Writing achievement than Reading. How can we accelerate progress in this area? Is critical thinking an area that needs to be developed for students to be successful in this area?

Math
In general Students across all ages are (1 year) below the National Norm in Maths. We need to accelerate this in order to make progress. When looking into ethnicity Pasifika and Maori are on average 2 years below the National Norm - Why is this?


This is a great place to start for our inquires this year. The researchers always have me leaving with more questions. It is positive to have such clear information and data to think about.
I guess you will just have to wait and see which area I plan on focusing in on this year!


Positive Progress in Numeracy!!!

Seems like a long time since I last posted, boy a lot of things have happened! 

As most educators know the middle of the year is reporting time. A good chance to reflect on where the students are and how much progress they have made in the first two terms. 

First of all I would like to share the things that I believe made the difference for these learners: 
- Create and Share (students were encouraged to create and share their learning in numeracy on to their blogs). This led to higher engagement and therefore positive results. 
- Tracking - using sheets to track student progress meant that it was easy to see when a student needed extra support or when they could move on. This is also what I used to determine what stage they were working at. 



At the beginning of Term Three I took on the role of Uru Mānuka Programme Leader. This means that I am no longer in with these students teaching them Numeracy... I am hoping that the positive progress that they have made in the beginning of the year continues! These students are making nearly a year worth of progress in a couple of terms... Some students moving from Early Stage 4 to the middle to end of Stage 5 which is really exciting! 
The hypothesis that: "Students who use learn, create, share in Numeracy will see their work as purposeful, therefore will be more engaged and achievement will increase, is proving quite accurate! 
This of course links to Karen Belt's 2016 Inquiry into "Using an authentic audience to enhance the motivation and writing mileage for learners in my classroom." I was trying to make connections across subjects and I think I have found some great beginnings of this. 

2017 Numeracy Review

As part of my role within the school, it was my job to complete a Numeracy Review. The key area that I chose to look at was Number Knowledge and Basic Facts. 
My key evaluative question-

Is a lack of number knowledge and basic facts a contributing factor to students not achieving in Numeracy?  What strategies may support accelerating the progress within this area?

I think that this was a good chance to tie in with my Spark-MIT Inquiry. The identified problem is much the same:
Students across the school are not achieving well in Numeracy. Students in the Senior School are struggling to meet National Standard.
Students in the Senior Hub are lacking in their basic facts knowledge and are therefore struggling to continue learning past stage 4 (Stage 4 is the National Standard for after 3 years at school).  
The ikan assessment which is taken in Year 4-6 every term, shows that students struggle with quick recall of knowledge.

The Data
57% of students are sitting Below or Well Below National Standard.

Some questions that I was asking myself from this data are:
  • Knowing what we know about authentic purpose and audience and motivation of students to achieve in Literacy, is there any way we can transfer this to Numeracy? (Kelsey’s Spark-MIT is looking into this further)
  • Are students being given scaffolding in and out tasks in Numeracy?
  • Are we measuring OTJ’s for Numeracy the same across the school?
  • How are we teaching basic facts across the school?
  • How are we tracking student progress across the school?

I felt that it was also important to get more information from the students and therefore completed a student survey.

Feedback from students survey (Rata + Tawa classes)
Students mostly feel okay or happy to do math.
Students mostly feel that they are quick with basic facts
71% of students that have used xtra math say that xtra math is a good way to learn basic facts
Majority of students would rather do basic facts online than with pencil and paper.

I also put out a similar survey to the parents and wider community...
Feedback from parent survey (14 parents)
Most parent feel happy with their knowledge of numeracy to support their child.
50% would like a parent evening and 50% would not.
90% of parents say their child uses mathletics or other online math programs at home.
All parents say that they have an extra 10mins for basic facts practise each night.
Parents would like fun ways to do times tables and basic facts, like there is for reading. Three of the parents would also like some math homework for their child.

It is great to see that the attitude towards math is mainly positive. I do believe that Numeracy Knowledge is a huge barrier to achievement. To move on from here it is a matter of finding some key ways to engage learners to continue learning basic facts at home. I have been reading a lot of Matt Goodwin's posts about his own Basic Facts Inquiry. It is reassuring to see that others are encountering similar problems when it comes to basic facts.


Manaiakalani Teacher Only Day - Structured literacy for older struggling students - Betsy Sewell

  English is extremely complex:  - Our alphabet letters to sounds  - It's not one language it comes from many other languages and moulds...