• No results found

Strategic Research RIVM. Annual report 2008

N/A
N/A
Protected

Academic year: 2021

Share "Strategic Research RIVM. Annual report 2008"

Copied!
56
0
0

Bezig met laden.... (Bekijk nu de volledige tekst)

Hele tekst

(1)

Strategic Research RIVM

Annual report 2008

Report 000200904/2009 N.A. Smeenk | J.M.H. Demon

(2)

RIVM report 000200904/2009

Strategic Research RIVM

Annual report 2008

N.A. Smeenk J.M.H. Demon

Contact:

Nicoline Smeenk and Annemiek Demon Corporate Affairs

nicoline.smeenk@rivm.nl, annemiek.demon@rivm.nl

(3)

© RIVM 2009

Parts of this publication may be reproduced provided the source is properly mentioned:

(4)

Rapport in het kort

Strategisch Onderzoek RIVM Jaarrapportage 2008

Dit rapport brengt verslag uit van het Strategisch Onderzoek RIVM (SOR) in 2008, het eigen onderzoeksbudget van het RIVM. Dit onderzoeksgeld is bedoeld om te voorzien in de expertise en kwaliteit om nu en in de toekomst de taken voor de opdrachtgevers adequaat uit te kunnen voeren. In 2008 is ongeveer 12,9 miljoen euro aan SOR besteed.

Het verslagjaar omvat het tweede jaar van de vierjaarlijkse cyclus van SOR-onderzoek die in 2007 is gestart. De uitvoering van de meeste projecten is in 2008 goed op stoom gekomen, wat tot een groot aantal publicaties heeft geleid. Er zijn 78 publicaties verschenen in peer-reviewed tijdschriften en er zijn 62 publicaties ingediend. Bij twee derde van de verschenen publicaties is een medewerker van het RIVM eerste, tweede of laatste auteur. Er zijn ook een groot aantal andere producten opgeleverd, te weten 36 (brief)rapporten, 105 lezingen op internationale congressen, 14 websites, 19 databases en 22 instrumentaria zoals modellen. Daarnaast is de voortgang terug te zien in aanvullende opdrachten en de participatie van het RIVM in internationale projecten. Ook ontwikkelt de samenwerking met externe onderzoeksinstituten zich goed.

Het rapport geeft een indicatie van de wetenschappelijke en maatschappelijke impact van het SOR-onderzoek. Ten opzichte van wetenschappelijke referentietijdschriften is meer dan gemiddeld goed gescoord. De maatschappelijke impact wordt gebaseerd op scores op een aantal indicatoren, die de komende jaren worden gevolgd. De index voor 2008 is voor de meeste speerpunten hoger dan in 2007. Dit is onder meer het gevolg van een groeiend aantal vervolgopdrachten, het gebruik van de resultaten in beleid of richtlijnen en externe verzoeken om advies naar aanleiding van de SOR-projecten. Trefwoorden:

strategisch onderzoek, toekomst, anticiperen, speerpunten, maatschappelijke impact, wetenschappelijke impact

(5)
(6)

Abstract

Strategic Research RIVM Annual Report 2008

In this document, the National Institute for Public Health and the Environment (RIVM) reports on progress that was made in 2008 within its Strategic Research Programme (SOR).

The Strategic Research Programme helps the institute to anticipate upcoming research questions, to ensure the quality of its scientific expertise and to participate fully in international research networks. In 2008, about € 12.9 million was allocated to work carried out within the Programme.

The current Programme runs from 2007 to 2010. Most SOR projects reached full speed in 2008, which resulted in a sharp increase in the number of research publications. A total of 78 SOR-related papers were published or accepted for publication in international, peer-reviewed journals, another

62 papers were submitted for publication. Two thirds of the published papers had RIVM staffers as first, second and/or last author.

Strategic research also produced many other products including 36 (letter)reports, 105 talks at international meetings, 14 websites, 19 data bases en 22 tools such as computer models.

Progress could also be measured in terms of RIVM gaining follow-up assignments, taking part in international research projects and further expanding its long-term collaboration networks with other institutes.

This annual report monitors the Programme’s impact on science and society in 2008. Research output quantity rose, while on the whole peer-reviewed research papers were accepted or published in journals with higher-than-average impacts.

To measure the Programme’s impact on society, a number of indicators have recently been developed. Performance on these indicators will be monitored over the coming years. In 2008 the index increased, mainly the result of increasing follow-up assignments, the use of the results in policy and external requests for advice.

Key words:

(7)
(8)

Contents

Contents 7

1 Introduction 9

1.1 Introduction 9

1.2 Purpose of this report 9

1.3 Reading guide 9

2 2007-2010 research themes 11

2.1 The significance of strategic research for RIVM 11

2.2 Research theme choice and evaluation 11

2.3 Risk Perception, Consumer behaviour and understanding (RPC) 12

2.4 Emergency Response Functions (ERF) 12

2.5 INFectious diseases (INF) 12

2.6 Chronic diseases Intervention and Lifestyle (CIL) 13

2.7 Medicines and Functional Foods (MFF) 13

2.8 Environmental Quality and Health (EQH) 13

3 Strategic research progress in 2008 15

3.1 Monitoring progress 15

3.2 Strategic Research Programme (overall) 15

3.3 Risk Perception, Consumer behaviour and understanding (RPC) 15

3.4 Emergency Response Functions (ERF) 15

3.5 INFectious diseases (INF) 16

3.6 Chronic diseases Intervention and Lifestyle (CIL) 16

3.7 Medicines and Functional Foods (MFF) 17

3.8 Environmental Quality and Health (EQH) 17

4 2008 in numbers 19

4.1 Research quantity indicators 19

4.2 Research quality indicators 19

4.3 Other research output 20

4.4 The impact of strategic research on society 21

4.5 Societal impact summary scores 23

4.6 Finances 23

5 Conclusion and outlook for 2009 25

5.1 General assessment 2007-2010 Programme 25

5.2 Progress in 2008 25

5.3 Midterm review 25

(9)

Annex 1 Research programmes and projects 27

Annex 2 Papers from SOR projects in 31

Annex 3 Research quality methodology 42

Annex 4 Reference journals 2008 43

Annex 5 New assignments 51

Annex 6 Indicators for the impact of health research on society 52

(10)

1

Introduction

1.1

Introduction

The National Institute for Public Health and the Environment (RIVM) in the Netherlands has a dedicated budget for initiating and carrying out strategic research. Through its Strategic Research Programme (Strategisch Onderzoek RIVM, SOR), the institute is able to anticipate upcoming research questions, to ensure the quality of its scientific expertise and to participate fully in long-term

international research networks.

The Strategic Research Programme is set up using four-year programme and budget cycles. The current cycle started in 2007. The programme comprises of 6 strategic research themes, which together cover 60 individual research projects.

1.2

Purpose of this report

RIVM reports annually on the progress achieved within its Strategic Research Programme. This report covers activities in 2008 and provides various measures:

• research progress within all 6 research themes; • research output (e.g. papers, talks, other products); • scientific impact of the research;

• its impact on society; • finances.

This report provides measures at the research theme level. A separate Appendix to the report provides further information at individual project level (Strategic Research RIVM , Project progress, appendix to annual report 2008, RIVM report 000200905).

1.3

Reading guide

Chapter 2 restates why the Strategic Research Programme is of vital importance for RIVM and summarizes the scope of its current research themes.

Chapter 3 describes the progress that was made in 2008 in general terms, both at the programme and research theme levels.

Chapter 4 presents and analyses qualitative measures of research output. Chapter 5 sums up with general conclusions.

(11)
(12)

2

2007-2010 research themes

2.1

The significance of strategic research for RIVM

The National Institute for Public Health and the Environment (RIVM) is the Netherlands’ most important public research institute in the areas of public health, environment, safety and nutrition. Its primary task is to support the Dutch government in making science-based policy by providing sound and independent counsel. RIVM’s advice typically reflects a large body of scientific evidence and often builds on full risk assessments or risk management procedures.

In addition to this, RIVM carries various executive responsibilities in the areas of national health and the environment. RIVM’s other (international) clients include public organisations such as the World Health Organisation (WHO), the European Commission (EC) and various agencies of the European Union (EU).

Strategic research, as carried out within the Strategic Research Programme (SOR), serves to reinforce the institute’s national and international position and to increase its scientific authority by contributing more to peer-reviewed scientific publications. For RIVM, doing scientific research means connecting with academic research and research communities.

Through its strategic research, the institute aims to anticipate research and policy questions that may arise in the (near) future. Such research, by definition, involves innovations and carries some risks.

Due to the financial structure of an agency, regular commissions prevail. Apart from the new knowledge that is acquired during this work, separate investments are needed to safeguard the institute’s expertise and craftmanship. In one sentence: SOR serves to keep RIVM scientifically well prepared for the day after tomorrow and realize its future professional skills.

The RIVM’s Director-General holds the SOR budget and formally commissions all strategic research. The 2007-2010 Programme comprises about 60 research projects grouped into six strategic research themes. In each of the themes, all projects wil be reviewed midterm and recommendations to RIVM’s management board will be made. Recommendations and management decisions may include continuation with or without adaptations and project discontinuation.

2.2

Research theme choice and evaluation

RIVM’s strategic research must fit within a limited number of carefully chosen research themes. They serve as the Strategic Research Programme’s overall framework. Research themes must align with RIVM’s strategic areas and should anticipate future developments. They are chosen in close

consultation with the RIVM’s Supervisory Board. The six themes of the 2007-2010 Strategic Research Programme were chosen in 2006.

The 2008 review evaluated how research themes have been implemented in research projects. Most themes have grouped various projects into distinct research programmes. All research themes and programmes are summarised below. Annex 1 provides a full list of priorities, programmes and projects.

(13)

Much of RIVM’s research is multidisciplinary so overlaps between themes and programmes do occur. Theme coordinators meet frequently to ensure that all research keeps the right focus.

2.3

Risk Perception, Consumer behaviour and understanding (RPC)

Theme purpose

Studies into risk assessment, risk perception and consumer behaviour are highly relevant to many issues in society today. Research within this theme affects one of RIVM’s core competences and is therefore important to most if not all of the institute’s divisions. The theme offers many opportunities for interdivisional cooperation.

Programmes

Research projects in this theme are grouped into two research programmes. One focuses on animal experimentation, both to properly estimate risks and to reduce our dependence on laboratory animals. The other focuses on risk information and quality.

2.4

Emergency Response Functions (ERF)

Theme purpose

In today’s world, governments need to prepare for emergencies. Whether they involve chemical, biological or radiation exposures or other types of calamities, all such emergencies require sensible preparation for an adequate response. In recent years, bioterrorism and infectious disease outbreaks have attracted attention. Other needs include modelling of environmental risks from chemicals or radiation, and research into toxicological effects in humans as well. At least two RIVM divisions need to be fully up to date on safety and emergency response functions.

Programmes

Research projects in this theme are grouped into three programmes: (1) risk assessment methods in emergencies, (2) clinical toxicology and (3) measurement and modelling.

2.5

INFectious diseases (INF)

Theme purpose

The theme includes research into questions ranging all the way from infectious agents to effective epidemiological interventions. Food safety issues are relevant as well. Research within this theme will help reinforce RIVM’s expertise in areas such as immunology, vaccination and genetics. Effect studies and modelling are highly important as well.

Programmes

Research projects in this theme are grouped into three programmes: (1) genomics, (2) immunology and (3) modelling.

(14)

2.6

Chronic diseases Intervention and Lifestyle (CIL)

Theme purpose

Chronic diseases and lifestyle changes constitute growing problems and require policy-making at local, national and international levels. Some knowledge about preventive interventions could be

implemented more fully, and new types of prevention should be developed. High-risk groups need to be identified early on and receive special attention. Increasingly, links between life styles and health are being debated, and citizens are encouraged to adjust their behaviours. Food quality, obesity, diabetes, cancer, medical screening, and quality of life are just a few of the issues that are more and more coming together, and the trend will most likely continue. Growing expertise on these interfaces at RIVM will be needed.

Programmes

Research projects in this theme are grouped into four programmes: (1) modelling chronic diseases, (2) healthy aging, (3) quality of care, and (4) economic evaluations.

2.7

Medicines and Functional Foods (MFF)

Theme purpose

More and more, medicines and novel foods become intertwined, and RIVM needs to acquire more expertise in this area. Straightforward risk assessments are moving towards risk-versus-benefit and chain approaches. Also, it is becoming more important to understand system functions in care, and consumer behaviour and understanding need to receive proper attention.

Programmes

Projects within this theme are all highly related so no separate programmes are identified.

2.8

Environmental Quality and Health (EQH)

Theme purpose

Monitoring remains vital in many environmental areas, such as particulate matter. Risk assessments for encouraging healthy environmental conditions or evaluating economical activity are becoming

increasingly important. More research needs to go into identifying behavioural scenarios and risk perceptions. Complicated risk assessments and environmental health impact assessments need to be developed. The EQH theme reflects the diversity of RIVM’s Environment and Safety Division, but other divisions are involved in assessing environmental health effects.

Programmes

Research projects in this theme are grouped into three programmes: (1) risk assessment, (2) environmental health impact assessment and measurement and (3) modelling.

(15)
(16)

3

Strategic research progress in 2008

3.1

Monitoring progress

Since 2007, progress of strategic research projects is monitored and reported to RIVM’s Director-General on an annual basis. By completing yearly progress reports, project leaders provide information about the project’s goals, progress, products and finances. They report changes in the objectives or approaches and make projections on work and products in the next year. The questionnaires are used by theme coordinators to produce reports at the theme level.

This chapter summarizes 2008 progress in general terms. Research output in terms of papers and reports that were published is given in the next chapter (chapter 4).

Progress reports at the project level can be found in a separate Annex to this report (Strategic Research RIVM, Project progress, appendix to annual report 2008, RIVM report 000200905)

3.2

Strategic Research Programme (overall)

Before 2008, 59 SOR-related research projects had already started. In 2008, another 7 projects got off the ground. Most projects picked up speed during the second year of the programme cycle. Some project leaders, however, noted that government cutbacks had made it more difficult to provide sufficient human resources to the projects. Solutions included outsourcing of some of the work and strengthening partnerships.

3.3

Risk Perception, Consumer behaviour and understanding (RPC)

All RPC projects began in 2007 and are now very close to delivering products. For example, the Proteomics for population screenings project reported important progress in particular on new diagnostic methods. The Toxicogenomics in Risk Assessment project reports that genomics-related techniques appear to go well with innovative risk approaches. The techniques also hold promise for other RIVM divisions and the Netherlands Toxicogenomics Centre in which RIVM participates. Follow-up research to support innovative risk assessment procedures seems promising. The Nano-Technology, Potential Risks project has earned additional outside funding. The Effective Use of Performance Indicators project and the Methods for Dietary Exposure Assessment project both were productive as well. Given the progress, there are no reasons to make adjustments within the RPC theme.

3.4

Emergency Response Functions (ERF)

The ERF theme mostly consists of new projects, which in 2008 picked up speed, as can be gleaned from the data on output presented in the next chapter. Various projects attracted additional assignments. Researchers joined international research efforts and initiated other collaboration arrangements with outside partners. Some project leaders noted that a combination of staff departures and government cutbacks had made it more difficult for them to provide human resources. As a result, some of the work

(17)

was outsourced or handled jointly with outside partners. A SOR-related strategic alliance with Utrecht University was highlighted by the inaugural lecture of a RIVM-based part-time professor. In one project, 2008 scientific output levels have triggered specific attention.

3.5

INFectious diseases (INF)

Progress in most INF projects was according to expectations, although some projects reported delays in publishing results. The theme comprises of three programmes: genomics, immunology and modelling. Genomics projects included (1) whole-genome analysis of M. tuberculosis, (2) microarrays to map pertussis adaptation, (3) whole-genome analysis of B. pertussis and (4) a study on Rickettsia in ticks (started in 2008). Progress in genomics projects was good, including efforts to analyse and present genomics data. Private parties are showing interest

The immunology programme is considered important because immunology is not part of the Centre for Infectious Disease Control Netherlands (CIb’s) usual work for the Ministry of Health, Welfare and Sport. The programme involves four projects: (1) immunomodulation by helminth infections, (2) memory immunity, (3) immune pathways in vaccination and (4) host response to Respiratory Syncytial Virus (RSV). Progress in the immunology projects was less than originally planned mainly due to difficulties in getting results published. Several papers are projected to be published in 2009, however. Modelling projects focused on (1) the future of MRSA in the Netherlands, (2) tracking emerging epidemics, (4) epidemic modelling of molecular data and (4) chlamydia positivity (started in 2008). The mathematical modelling projects yielded interesting results, leading to published research papers. Also, a lecture at a meeting on SOR at the Ministry of Health, Welfare and Sport in October 2008, demonstrated the programme’s appeal to policymakers.

Within the INF theme, an open call for proposals was held. After peer review four new projects were selected (marked in Annex 1), two of which (both related to food born norovirus infections) fell outside the scope of the three programme’s.

Three projects receive co-financing from the European Commission: VITAL, immune pathways in vaccination and chlamydia positivity. Duration of projects varies from two to four years. Almost all projects have strategic alliances with universities. In five projects, a PhD student carries out part of the research.

3.6

Chronic diseases Intervention and Lifestyle (CIL)

Most projects within the CIL theme made good progress in 2008. Two new projects were launched: (1) chronic disease in children and (2) communicating about uncertainty in economic evaluations. Some projects attracted international attention, such as the one on knowledge transfer. By late 2008, two projects were completed successfully. The first, on calculations of future healthcare costs, produced three published papers. The second, a preliminary study on primary health care, led to a plan for a third national study on the same subject, which is now being considered by the Ministry of Health, Welfare and Sport (VWS).

(18)

3.7

Medicines and Functional Foods (MFF)

All projects from the 2003-2006 SOR cycle were fully completed in 2008. A new project, called Biothree, was launched. In the Chronic drug use and autoimmunity project, an interesting association between chronic use of statins and an above-average prevalence of arthritis was found. The MAGIC project, on drug use in children, is beginning to bear fruit as well. After a difficult first year, research within the MFF theme has clearly begun to make progress.

3.8

Environmental Quality and Health (EQH)

Most projects within the EQH theme made good progress. Solutions were found to start-up problems in the previous year, such as difficulties in attracting qualified staff. They include arrangements with other research organisations such as PhD student contracts. Research output has picked up speed. Some projects report additional assignments and participation in international projects.

Among the year’s highlights was the Flash Environmental Assessment Tool (FEAT), a spin-off from the EIA (Environmental Impact Assessment) project. Within a short time frame, at the request of the United Nations, RIVM researchers developed a tool to quickly identify acute environmental risks immediately following disasters in developing countries. SOR-based methodology was also used in studies on disease prevalence among people living close to a CORUS location in the Netherlands. One of the studies, on cancer prevalence, was completed in 2008 and received good marks during an international audit. Some project leaders in the EQH theme noted that government cutbacks had made it more difficult to provide sufficient human resources. Because of that, some of the work was outsourced or handled jointly with outside partners.

SOR-related strategic alliances with Utrecht University and Radboud University (Nijmegen) were highlighted by inaugural lectures of RIVM-based part-time professors.

(19)
(20)

4

2008 in numbers

4.1

Research quantity indicators

Research output in terms of scientific papers or reports that were published is presented below. Annex 2 contains references to published and accepted papers for each research project.

The 2007-2010 Strategic Research Programme

In 2008, a total of 78 SOR-related scientific papers were published or accepted for publication in international peer-reviewed journals. This is roughly 15 % of the total number of RIVM publications. Two thirds (52) of these papers had RIVM staffers as their first, second and/or last author, signifying particular importance of the research for the institute. Another 62 papers were submitted for publication to editors of similar journals. One PhD thesis was completed in 2008. Of course, work for this thesis had been carried out in large part in previous years.

Table 4.1 presents a breakdown of these numbers per theme. Table 4.1 Number of research papers SOR 2007-2010

Theme Subm Acc+publ Total

Acc+publ 1st, 2nd or last author Theses RPC (7) 7 7 14 5 0 ERF (7) 0 6 6 5 0 INF (15) 9 9 18 7 0 CIL (17) 27 28 55 12 0 MFF (6) 3 9 12 8 0 EQH (15) 16 19 35 15 1 Total 62 78 140 52 1

Between brackets the number of projects per theme Subm submitted for publication

Acc accepted for publication Publ published

Compared to 2007, the number of scientific papers accepted and published almost doubled, demonstrating that most projects reached full speed.

One project from the 2003–2007 Strategic Research Programme cycle was ongoing in 2008 and produced one scientific publication that same year.

4.2

Research quality indicators

In 2002, consultations with RIVM’s Scientific Advisory Board led to the selection of quality indicators for strategic research. The indicators were based on methodology developed at the Faculty of

Veterinary Medicine of Utrecht University. They were used for the 2003-2006 Strategic Research Programme and, with minor modifications, are used for the current cycle as well.

(21)

The methodology is based on the impact factors of all journals in which papers were published. It measures the quality, not the quantity of the output. For every research theme, the average impact factor is calculated from journals that accepted and published its papers. Scores are compared to a ‘standard’, which is the average impact factor of all reference journals relevant for that particular theme (not including journals with impact factors >15). The comparison leads to assessments on a five-point scale where 5 is highest, 1 is lowest and 3 represents an average, perfectly acceptable score. A more detailed explanation of the methodology is given in Annex 3. A list of reference journals per theme is given in Annex 4.

Table 4.2 presents average impact factors and assessment scores for all research themes. Table 4.2 Indicators of scientific quality per theme 2007-2010: average impact factors

RPC ERF INF CIL MFF EQH

Average impact factor 2007 4.787 - 3.937 4.508 - 2.626

Standard 2007 3.650 2.598 3.878 3.321 3.160 2.043

Assessment Class (1-5) 5 - 3 5 - 4

Average impact factor 2008 3.786 2.543 5.501 8.807 2.913 3.305

Standard 2008 3.569 2.764 3.932 3.466 3.163 2.217

Assessment Class (1-5) 3 3 5 5 3 5

A number of observations have been made on the use of this methodology:

• Assessment scores should be seen as indicative only. Impact factors vary greatly, and researchers are able to influence the standard against which they are measured by providing lists of reference journals.

• Assessment scores do not take into account the quantity of the output, just the quality of the journals in which output was published. One paper in a top journal may seem to outperform twenty papers in less outstanding but still highly respectable journals. Therefore, Table 4.2 should always be evaluated together with the number of papers published (Table 4.1).

• RIVM’s primary purpose is helping answer policy questions. While achieving high research quality is highly valued within the institute and elsewhere, it will not always be possible. That may be true in particular for research that is aimed at developing new methods.

Such observations notwithstanding, overall results were very good. Most themes achieved higher impact scores than the pre-achieved standard. Themes INF, CIL and EQH were assessed as Class 5, while none of the other themes was assessed lower than Class 3.

4.3

Other research output

The 2007-2010 Strategic Research Programme

Strategic research also produced many other tangible products. 36 (letter) reports were written, 105 talks at international meetings presented, 14 websites built, 19 data bases set up en 22 tools (such as computer models) created. Table 4.3 presents a breakdown of these numbers per theme.

(22)

Table 4.3 Other research products

Theme Rep. Letter. Talks Tools Databases Sites

RPC (7) 1 0 12 0 0 0 ERF (7) 1 1 5 0 0 0 INF (15) 0 0 14 5 2 0 CIL (17) 3 1 19 1 3 3 MFF (6) 0 2 7 1 0 1 EQH (15) 22 5 48 15 14 10 Total 27 9 105 22 19 14

Between brackets the number of projects per theme Rep. Reports

Letter. Letter reports

Talks Talks presented at international meetings Tools Tools (e.g. models)

Databases Databases Sites Web sites

4.4

The impact of strategic research on society

According to the Scientific Advisory Board, applied research carried out at the institute should not only have strong scientific merit but should bring value for society as well. In order to properly assess that value, the Board has asked the institute to develop straightforward and cost-effective indicators by which to measure the Strategic Research Program’s impact on society, and to begin monitoring that impact as part of the 2007-2010 program cycle.

As of yet, no general consensus exists on the best methodology by which to assess the impact of research on society. What's more, there is not even a generally accepted definition of what the impact of research on society is. For RIVM, a definition proposed by Eijsackers (WUR, 2007) seems the most applicable: Research has an impact on society when its outcomes can be used by governments,

industry, non-governmental organizations or the general public because they: • could lead to direct applications;

• offer solutions to social problems or address social developments; • answer questions that arise in society or fulfil societal needs.

Also, research should address a significant problem or issue, i.e. serve a general interest.

RGO guidelines on health research impact indicators

In December 2007, the Advisory Council on Health Research (RGO), a body advising the Dutch government on health and health services research, published a report on assessing the impact of research on society. Titled ‘Research that matters’ (“Onderzoek dat ertoe doet”), the report offered a list of indicators that gauge the impact of health research. The Council stressed the limited experience with applying such indicators and warned against putting too much emphasis on numerical values as of yet. The Council rather presented its list as a rough guide that should be experimented with. In setting up such experiments, users should select their own indicators based on the general list.

From RGO’s general list (see Annex 6), RIVM has selected a short list of indicators that seem most suitable to measure the impact of the institute’s Strategic Research Program. In making the selection, RIVM included the following rationale:

(23)

• RIVM’s strategic research has a particular focus – it is primarily targeted at demand that will most probably materialize in the future.

• Many factors contribute to measurable health impacts, and typically it will be hard to contribute such impacts directly to the strategic research program itself.

Strategic Research RIVM impact indicators

Obviously all RIVM research, including that carried out as part of the Strategic Research Program, should ultimately have positive effects on society. Such effects, however, will usually become visible only at a much later time. All selected indicators may be called indirect: we may assume that, when third parties apply RIVM research outcomes, or when RIVM is asked for advice based on the fruits of its work, there will most probably be future impact. Following the same line of thinking, follow-up assignments were added as indicators because they can be seen as clear signs of outside interest in RIVM research results.

Some indicators on the list of the Advisory Council on Health Research could indeed be very meaningful when applied to RIVM as a whole. These include, for example, contributions to

professional education, informing the public through authorized web sites, and references to research in public media. However, it would be very difficult to directly contribute performance on such indicators to strategic, long-term research. Therefore these indicators were not deemed suitable for measuring societal impact of the Strategic Research Program. The Advisory Council on Health Research also presented a list of indicators for the assessment of economic impact of health research. For similar reasons, these indicators were also deemed not very suitable for measuring the impact of RIVM’s strategic research.

In the end, the following process- and product-based indicators were identified. For all these indicators, performance will be assessed and quantified annually:

• follow-up assignments from primary clients; • follow-up assignments from secondary clients;

• use of outcomes in guidelines, regulation, policies and so on; • requests for advice from third parties;

• participation in international bodies.

Strategic Research Programme 2007-2010

Table 4.4 presents performance scores on selected societal impact indicators for all research themes. Table 4.4 Research themes and their performance on selected societal impact indicators

Theme Follow-up Prim

Follow-up Sec.

Use Advice Particip. Total

RPC (7) 2 1 2 1 3 9 ERF (7) 3 2 2 3 3 13 INF (15) 0 2 0 7 2 11 CIL (17) 3 4 9 11 4 31 MFF (6) 0 0 6 0 2 8 EQH (15) 2 5 16 9 12 44 Total 10 14 35 31 26 116

(24)

Follow-up Prim. Follow-up assignments from primary clients Follow-up Sec. Follow-up assignments from secondary clients

Use Use of outcomes in guidelines, regulation, policies and so on. Advice Requests for advice from third parties

Particip. Participation in international bodies

4.5

Societal impact summary scores

Within the Strategic Research Program, the various research themes differ significantly in terms of budgets and numbers of projects. As of yet, there is no absolute standard to which a theme’s performance can be compared. For now, the scores can only be used to compare individual research themes and to monitor the Strategic Research Program’s impact over the years. Some in the field have experimented with methodologies that use weighted performances. Weightings could be based on differences between areas of research, for example. At this point, no weightings have been applied to calculate scores for RIVM’s Strategic Research Programme. This might change in the future, for example based on discussions within RIVM’s Board of Supervisors. Table 4.5 presents societal impact summary scores for each of the research themes in 2008.

Table 4.5 Research themes and their societal impact summary scores

Theme Nr. of projects 2008 2008 summary score 2007 summary score RPC 7 9 9 ERF 7 13 3 INF 15 11 7 CIL 17 31 16 MFF 6 8 0 EQH 15 44 32 Total/ Average 67 116 67

Annual reports will continue to present societal impact summary scores in the future, making it easier to assess impact trends over time. For example, Table 4.5 shows that between 2007 and 2008 societal impact summary score for RPC was stable, while scores rose markedly for the other themes.

RIVM monitors the development of methodologies to assess societal impact used by others in the health research field. If possible and needed, newly developed methodologies will be incorporated into future Strategic Research Programme reports.

4.6

Finances

1

Prior to 2007, the strategic research budget frequently ended up being not fully exhausted. Therefore, research in the 2007-2010 Programme cycle was budgeted at 120 percent of the available funds. In 2008, €12.8 million was allocated while €11.0 million was actually available. In the end, more than

(25)

100 percent of the available funds were spent. The surplus has been accounted for through adjustments in the policy budget of the Director-General (DG).

Table 4.6 presents the funds that were spent for each theme out of the DG’s 2008 budget.

The table does not include expenditures that were paid using funds from external sources, such as funders who co-finance research by matching RIVM’s own funds. In the table, the second column presents the amounts invested by RIVM in co-financed projects. The table’s third column presents the number of hours that were put in by RIVM staff, not including hours paid from RIVM funds invested in co-financed projects. (Accounting rules stipulate that such hours should be reported elsewhere.). Table 4.6 Budget spent per theme

Theme € total Of which €

co-financing

Hours spent excl. hours co-financing RPC (7) 1.847.152 76.666 10.581 ERF (7) 1.478.759 22.500 8.915 INF (15) 2.104.754 43.200 13.378 CIL (17) 2.495.206 271.243 14.271 MFF (6) 1.165.748 0 9.332 EQH (15) 3.720.558 703.564 20.783 2003-2006 projects (1) 65.796 0 179 Total 12.877.973 1.117.173 77.439

(26)

5

Conclusion and outlook for 2009

5.1

General assessment 2007-2010 Programme

Assessments of progress within the Programme’s research have not yielded indications that research themes and/or projects should be adjusted in 2009. By late 2008, all but one of the projects from the 2003-2006 Programme cycle had been completed.

5.2

Progress in 2008

Generally speaking, research output from RIVM’s Strategic Research Programme increased markedly between 2007 and 2008. (An increase was to be expected, however, since most research projects were launched in 2007.) On the whole, papers were accepted or published in journals with higher-than-average impact. Average societal impact index scores rose since 2007. In conclusion, 2008 was a good year for RIVM’s strategic research.

5.3

Midterm review

All projects that were halfway by late 2008, i.e. four-year projects that started in 2007, will undergo a midterm review in 2009. The midterm review serves to test the quality and the progress of individual projects. Evaluations will be carried out by theme coordinators based on a list of questions drawn up by RIVM’s Director-General. They take into account original plans as well as 2007 and 2008 progress reports, and they consult with independent experts inside and outside the institute. Based on the midterm review, theme coordinators will present recommendations for each project to the Director-General. The 2009 annual report will report on the recommendations and the decisions that will be based on them.

5.4

Preview: New projects in 2009

In the first six months of 2009, four additional research projects were launched as part of the 2007-2010 Strategic Research Programme. Two of these fall within the INF theme, one in the RPC theme and one in the MFF theme. Annex 7 lists full titles and project leaders. Outside review was applied to assess these projects’ proposals.

(27)
(28)

Annex 1 Research programmes and projects

S = Projects started in 2008 C = Projects completed in 2008

Theme: RPC

Programme Division Project nr.

Project leader Title

Experimental (animal) studies in risk assessment

CIb 230126 Ing. J.H.J. Reimerink

Proteomics for population screening

VGC 340010 Mw. Dr. M. Luijten Toxicogenomics in risk assessment

VGC 350010 Dr. Ir. M. C. Ocké Methods for dietary exposure assessment VGC 340050 Dr. L.T.M. van de

Ven

Alternatives for animal testing

VGC 340030 Dr. W. H de Jong Nanotechnology, potential risks Information to consumers VenZ 270136 Drs. H.C. Ossenbaard Getting.Better.nl VenZ 260196 Dr. W.C. Graafmans

Effective use performance indicators

Theme: ERF

Programme Division Project nr.

Project leader Title

Measuring and modelling

CIb 330006 Dr. B.J. van Rotterdam

Biothreat DNA micro-arrays

MEV 620001 Dr. P.A.M. Uijt de Haag

QRA

MEV 630007 Dr. Ir. L. Grievink Rapid assessments after disasters C MEV 609001 Mw Dr. S.M. Hoffer T-attacks Risk assessment in emergencies MEV 610003 Dr. C.J.W. Twenhöfel ERFRAD MEV 609002 Drs. Ing. N.J.C. van Belle

From sub acute to acute response

Clinical toxicology MEV 660001 Prof. Dr. J. Meulenbelt

(29)

Theme: INF

Programme Division Project nr.

Project leader Title

Modelling CIb 210026 Dr. H. Grundmann Modelling the future of MRSA in NL

CIb 210036 Dr. J. Wallinga Tracking emerging epidemics CIb 210046 Dr. J. Wallinga Epidemic modelling of molecular data S CIb 210056 Mw. Dr. M. E.E.

Kretzschmar

Chlamydia positivity and prevalence

Immunology CIb 230426 Mw Dr. A.M. Buisman

Memory immunity

CIb 230146 Mw Dr. B. Pinelli2

Ortiz

Immunomodulation by helminth molecules

S CIb 230166 Mw Dr. B. Pinelli Ortiz

Zoonotic helminth infections and allergy

VGC 230406 Dr. C.M. Janssen Host-response to RSV (Respiratory Syncytial Virus)

CIb 230416 Dr. R.S. Van Binnendijk

Immune pathways in vaccination

Genomics CIb 230136 Dr. D. v. Soolingen

Whole-genome analysis of M. tuberculosis

CIb 230436 Dr. A.J. King Microarrays to map pertussis adaptation CIb 230446 Dr. F.R. Mooi B. pertussis adaptation to vaccination

S CIb 330116 Dr. H. Sprong Ticks: Trojan horses with new surprises INF - other S CIb 230156 Dr. E. Duizer Transmission intervention strategies

S CIb V/330274 Dr. A. M. Roda Husman

VITAL: foodborn viruses

Bold = new projects started in 2008, of which 2 did not really fit in with the subprogrammes.

Theme: CIL

Programme Division Project nr.

Project leader Title

Modelling chronic diseases

VenZ 260146 Mw. Dr. Ir. W.M.M. Verschuren

Primary prevention research on cardiovascular diseases and diabetes

VenZ 210116 Dr. S.D. Mylius Adaptable chronic diseases modelling VenZ 260166 Mw. Dr. P.C.A.

Droomers

Modelling SES disparities in health

VGC 350040 Dr. Ir. J. Hoekstra Modelling health effects of nutrition Healthy ageing VenZ 206156 Dr.Ir. W.J.E.

Bemelmans

Healthy ageing: overweight/underweight

(30)

Programme Division Project nr.

Project leader Title

VGC 340020 Dr. M.E.T. Dollé Healthy ageing: gene diet interactions Quality of care VenZ 260116 Dr. G.P. Westert Health system performance Neth and CAN

C VenZ 270156 Dr. J.S. de koning Hospital performance measurement

VenZ 270116 Dr. C.H. van Gool Are diseases becoming less disabling?

Economic evaluations

VenZ 260176 Dr. T.L. Feenstra Communicating uncertainty in econ evals*

C VenZ 260186 Drs. G. A. de Wit Future unrelated medical costs Other VGC 350020 Dr. H.B. Bueno de

Mesquita

Primary prevention research on obesity, cancer and ageing

VenZ 270126 Mw. Dr. A.J. Schuit

Knowledge transfer in public health

VenZ 260126 Mw. Dr. A.H. Wijga

Lifestyle from childhood to adolescence

VenZ 260136 Mw. Dr. A.H. Wijga

Chronic diseases in childhood*

VenZ 270146 Mw. Dr.Ir. F. H.G.M. Hoeymans

Validation of data from general practise registries

C VenZ 270176 Mw. Dr. Ir. F. H.G.M. Hoeymans

Preparatory study for a national survey of primairy care

Theme: MFF

Programme Division Project nr.

Project leader Title

Not applicable VGC 340040 Dr. Ir. R.J. Vandebriel

Chronic drug use and autoimmunity

VGC 350030 Dr. Ing. H.J. v. Kranen

The food pharma interface

VGC 370020 Drs. D. A. v. Riet-Nales MAGIC VGC 360010 Mw. Dr. S.W.J. Janssen Farmaco-economie VGC 360020 Dr. M.H.N. Hoefnagel Immunogeniteit eiwitgeneesmiddelen VGC 370010 Dr. D.M. Barends Riskred S VGC 370030 Dr. D.M. Barends BIOTHREE

(31)

Theme: EQH

Programme Division Project nr.

Project leader Title

Risk assessment MEV 607001 Dr. L. Posthuma EIA: environmental impact assessment MEV 607002 Prof. Dr. A.M.

Breure

RICIERA: research cooperation in ecological risk assessment

MEV 601001 Dr. T.G.Vermeire ITS: integrated testing strategies MEV 630006 Mw. Drs. C.M.A.G.

van Wiechen

SMARAGHT: small area health analyses, a geographic toolkit

MEV 610002 Dr. H. Slaper COURSE: climate and ozone change effects Interface risk

assessment and EHIA

MEV 610001 Dr. H. Bijwaard MIRACLE: modelling ionizing radiation and cancer for low dose effects

Environmental Health impact assessment

MEV 630001 Prof. Dr. Ir. E. Lebret

IRAS: environmental health collaboration

MEV 630002 Mw. Dr. N. Janssen

RAPTES: risks of airborne particles

MEV 630003 Prof. Dr. Ir. E. Lebret

VAMPHIRE: versatile assessment methodology project for health impacts and risks in the environment

MEV 630004 Mw. Dr. A. B. Knol IQARUS: uncertainty in environmental BOD

MEV 630005 Dr. R. van Poll PACEHR: perception, appraisal and communication of enviironmental risks Measurement

methods

MEV 680001 Dr. Ir. W.A.J. van Pul

NITROGEN: Relating groundwater + air quality for N

MEV 680002 Dr. A. Apituley CESAR: climate and air quality monitoring MEV 680003 Drs. D.P.J. Swart AQURES: air quality and remote sensing C MEV 680004 Dr. J. Jabben NOISE: improving noise exposure assessments

(32)

Annex 2 Papers from SOR projects in 2008

• Listed are scientific papers published or accepted in international peer-reviewed journals • RIVM staff is printed in bold; papers with RIVM staffers as their first, second and/or last

author are marked with a checkmark (√)

• The list inclused theses related to SOR projects • For project titles, see Annex 1

RPC, S/230126, Proteomics for population screening

Hofhuis A ; Reimerink J ; Reusken C ; Scholte EJ ; Boer AD ; Takken W ; Koopmans M The hidden passenger of lucky bamboo: do imported aedes albopictus mosquitoes cause dengue virus transmission in the Netherlands?

Vector Borne Zoon Dis, accepted

RPC, S/260196, Effective use performance indicators

Vos M de ; Graafmans W ; Kooistra M ; Meijboom B ; Voor P van der ; Westert G Using quality indicators to improve hospital care: a review of the literature

Int J Qual Health Care, accepted

RPC, S/270136, Getting.Better.nl

Ossebaard HC

Happy flow: in pursuit of a consumers? J Med Internet Res, accepted

RPC, S/340030, Nanotechnology, potential risks

Barnes CA ; Elsaesser A ; Arkusz J ; Smok A ; Palus J ; Lesniak A ; Salvati A ; Hanrahan JP ; Jong WH de ; Dziubaltowska E ; Stepnik M ; Rydzynski K ; McKerr G ; Lynch I ; Dawson KA ; Howard CV

Reproducible comet assay of amorphous silica nanoparticles detects no genotoxiciy Nano Lett 2008; 8(9):3069-74

RPC, S/340050, Alternatives for animal testing

Kesteren PCE van ; Beems RB ; Luijten M ; Robinson J ; Vries A de ; Steeg H van

DNA repair-deficient Xpa/p53 knockout mice are sensitive to the non-genotoxic carcinogen cyclosporine A: escape of initiated cells from immunosurveillance?

Carcinogenesis 2009; 30(3):538-43

RPC, S/350010, Methods for dietary exposure assessment

Fransen HP ; Ock M

Indices of diet quality

(33)

Schickenberg B ; Assema P van ; Brug J ; Verkaik-Klosterman J ; Ocké MC ; Vries NK

Replacing foods high in saturated fat by low-saturated fat alternatives: a computer simulation of the potential effects on reduction of saturated fat consumption

Br J Nutr, accepted

ERF, S/610003, ERFRAD

Heuvelink GBM ; Jiang Z ; Bruin S de ; Twenhöfel CJW Optimization of mobile radioactivity monitoring networks Int J Geographical Information Sci, accepted

Hiemstra P ; Pebesma EJ ; Twenhöfel CJW ; Heuvelink GBM

Real-time automatic interpolation of ambient gamma dose rates from the Dutch Radioactivity Monitoring Network Computers & Geosciences, accepted

Hiemstra PH ; Pebesma EJ ; Twenhöfel CJW ; Heuvelink GBM

Automatic real-time interpolation of radiation hazards: prototype and system architecture considerations Int J Spatial Data Infrastruct Res 2008; 3(1):58-72

ERF, S/630007, Rapid assessments after disasters

Bongers S ; Janssen NAH ; Reiss B ; Grievink L ; Lebret E ; Kromhout H

Challenges of exposure assessment for health studies in the aftermath of chemical incidents and disasters J Expo Sci Environ Epidemiol 2008; 18(4):341-59

ERF, S/660001, Research cooperation in human toxicology

Hunault CC ; Mensinga TT ; Bocker KBE ; Schipper CMA ; Leenders MEC ; Vries I de ; Meulenbelt J Cognitive and psychomotor effects in males after smoking a combination of tobacco and cannabis containing up to 69 mg delta-9-tetrahydrocannabinol (THC)

Psychopharmacology 2009; accepted

Hunault CC ; Mensinga TT ; Vries I de ; Kelholt-Dijkman HH ; Hoek J ; Kruidenier M ; Leenders MEC ;

Meulenbelt J

Delta-9-tetrahydrocannabinol (THC) serum concentrations and pharmacological effects in males after smoking a combination of tobacco and cannabis containing up to 69 mg THC

Psychopharmacology 2008; 201(2):171-81

INF, S/210036, Tracking emerging epidemics

Heijne JCM ; Teunis P ; Morroy G ; Wijkmans C ; Oostveen S ; Duizer E ; Kretzschmar M ; Wallinga J

Enhanced hygiene measures and norovirus transmission during an outbreak Emerg Infect Dis 2009; 15(1):24-30

Mossong J ; Hens N ; Jit M ; Beutels P ; Auranen K ; Mikolajcyk R ; Massari M ; Salmaso S ; Scalia Tomba G; Wallinga J ; Heijne J ; Sadkowska-Todys M ; Rosinska M ; Edmunds WJ

Social contacts and mixing patterns relevant to the spread of infectious diseases PloS Med 2008; 5(3):e74

(34)

A simple explanation for the low impact of border control as a countermeasure to the spread of an infectious disease

Math Biosci 2008; 214(1-2):70-2

INF, S/210046, Epidemic modelling of molecular data

Boot HJ ; Cremer J ; Koedijk FDH ; Ballegooijen WM van ; Op de Coul ELM

Improved tracing of hepatitis B virus transmission chains by phylogenetic analysis based on C region sequences

J Med Virol 2008; 80(2):233-41

INF, S/210056, Chlamydia positivity and prevalence

Low N ; Heijne JCM ; Kretzschmar M

Use of mathematical modelling to inform Chlamydia screening policy decisions J Infect Dis 2009; 199(5):767-8

INF, S/230406, Host-response to RSV (Respiratory Syncytial Virus)

Pennings JLA ; Kimman TG ; Janssen R

Identification of a common gene expression response in different lung inflammatory diseases in rodents and macaques

PLoS ONE 2008; 3(7):e2596

Siezen CL ; Bont L ; Hodemaekers HM ; Ermers MJ ; Doornbos G ; Slot R van 't ; Wijmenga C ; Kimpen

JC ; Houwelingen HC van ; Kimman TG ; Hoebee B ; Janssen R

Genetic susceptibility to RSV bronchiolitis in preterm children is associated with airway remodelling genes and innate immune genes

Ped Infect Dis J, accepted

INF, S/230436, Microarrays to map pertussis adaption

King AJ ; Gorkom T van ; Pennings JLA ; Heide HGJ van der ; He Q ; Diavatopoulos D ; Heuvelman K Gent M van ; Leeuwen K van ; Mooi FR

Comparative genomic profiling of Dutch clinical Bordetella pertussis isolates using DNA microarrays: identification of genes absent from epidemic strains

BMC Genomics 2008; 9:311

Stenger RM ; Poelen MCM ; Moret EE ; Kuipers B ; Bruijns SCM ; Hoogerhout P ; Hijnen M ; King AJ ;

Mooi FR ; Boog CJP ; Els CACM van

Immunodominance in mouse and human CD4+ T-cell responses specific for the Bordetella pertussis virulence factor P.69 pertactin

Infect Immun 2009; 77(2):896-903

CIL, S/260186, Future unrelated medical costs

Feenstra TL ; Baal PHM van ; Gandjour A ; Brouwer WBF

Future costs in economic evaluation. A comment on Lee [Reply] J Health Econ 2008; 27(6):1645-9

(35)

Rappange DR ; Baal PHM van ; Exel NJA ; Feenstra TL ; Rutten FFH ; Brouwer WBF

Unrelated medical costs in life-years gained: should they be included in economic evaluations of healthcare interventions?

Pharmacoeconomics 2008; 26(10):815-30

CIL, S/270146, Validation of data from general practise registries

Dungen C van den ; Hoeymans N ; Gijsen R ; Akker M van den ; Boesten J ; Brouwer H ;

Smeets H ; Venn WJ van der ; Verheij R ; Waal M de ; Schellevis F ; Westert G What factors explain the differences in morbidity estimations among general practice registration networks in the Netherlands? A first analysis

Eur J Gen Pract 2008; 14(suppl 1):53-62

CIL, S/340020, Healthy ageing: gene diet interactions

A DL van der ; Rovers MM ; Grobbee DE ; Marx JJM ; Waalen J ; Ellervik C ; Nordestgaard

BG ; Olynyk JK ; Mills PR ; Shepherd J ; Grandchamp B ; Boer JMA ; Caruso C ; Arca M ; Meyer BJ ; Schouw YT van der

Mutations in the HFE gene and cardiovascular disease risk. An individual patient data meta- analysis of 53880 subjects

Circ Cardiovasc Genet 2008; 1:43-50

Andressoo JO ; Weeda G ; Wit J de ; Mitchell JR ; Beems RB ; Steeg H van ; Horst GTJ van der ; Hoeijmakers JH

An Xpb mouse model for combined xeroderma pigmentosum and cockayne syndrome reveals progeroid features upon further attenuation of DNA repair

Mol Cell Biol 2009; 29(5):1276-90

Berg SW van den ; Jansen EHJ ; Kruijshoop M ; Beekhof PK ; Blaak E ; Kallen CJ van der

; Greevenbroek MM van ; Feskens EJM

Paraoxonase 1 phenotype distribution and activity differs in subjects with newly diagnosed Type 2 diabetes (the CODAM Study)

Diabetic Med 2008; 25(2):186-93

Garcia AM ; Busuttil RA ; Calder RB ; Dollé MET ; Diaz V ; McMahan CA ; Bartke A ; Nelson J ; Reddick R ; Vijg J

Effect of Ames dwarfism and caloric restriction on spontaneous DNA mutation frequency in different mouse tissues

Mech Ageing Dev 2008; 129(9):528-33

√ Kuijsten A ; Bueno de Mesquita HB ; Boer JM ; Arts IC ; Kok FJ ; Veer P van 't ; Hollman PC

Plasma enterolignans are not associated with nonfatal myocardial infarction risk Atherosclerosis 2009; 203(1):145-52

Lu Y ; Dollé ME ; Imholz S ; Slot R van 't ; Verschuren WMM ; Wijmenga C ; Feskens EJ ; Boer JM Multiple genetic variants along candidate pathways influence plasma high-density lipoprotein

cholesterol concentrations J Lipid Res 2008; 49(12):2582-9 SOR-CIL 2008

(36)

Ouchida R ; Ukai A ; Mori H ; Kawamura K ; Dollé MET ; Tagawa M ; Sakamoto A ; Tokuhisa T ; Yokosuka T ; Saito T ; Yokoi M ; Hanaoka F ; Vijg J ; Wang JY

Genetic analysis reveals an intrinsic property of the germinal center B cells to generate A:T mutations

DNA repair 2008; 7(8):1392-8

Park JY ; Cho MO ; Leonard S ; Calder B ; Mian S ; Kim WH ; Wijnhoven S ; Steeg H van ; Mitchell J ; Horst GTJ van der ; Hoeijmakers J ; Cohen P ; Vijg J ; Suh Y

Homeostatic imbalance between apoptosis and cell renewal in the liver of premature aging Xpd-TTD mice

PLoS ONE 2008; 3(6):e2346

Schumacher B ; Pluijm I van der ; Moorhouse MJ ; Kosteas T ; Robinson AR ; Suh Y ; Breit TM ; Steeg H

van ; Niedernhofer LJ ; Ijcken W van ; Bartke A ; Spindler SR ; Hoeijmakers JHJ ; Hors GTJ van der ; Garinis

GA

Delayed and accelerated aging share common longevity assurance mechanism Plos Genetics 2008; 4(8):e1000161

CIL, S/350020, Primary prevention research on obesity, cancer and ageing

Besson H ; Ekelund E ; Luan J ; May AM ; Sharp S ; Travier N ; Agudo A ; Slimani N ; Rinaldi S ; Norat T ; Mouw T ; Rohrmann S ; Bergmann M ; Boeing H ; Clavel-Chapelon F ; Boutron-Ruault MC ; Jacobson MU ; Overvad K ; Tjonneland A ; Halkjaer J ; Gonzalez C ;

Rodriguez L ; Sanchez MJ ; Dorronsoro M ; Barricarte A ; Navarro C ; Key T ; Spencer E ; Orfanos P ; Naska A ; Trichopoulou A ; Manjer J ; Hallmans G ; Lund E ; Palli D ; Agnoli C ; Vineis P ; Panico S ; Tumino R ;

Bueno de Mesquita HB ; Odysseos A ; Riboli E ; Wareham NJ ; Peeters PH

Association between physical activity and obesity across 9 European countries: a cross- sectional analysis in the EPIC-PANACEA study

Int J Obesity 2009; accepted

Capella G ; Pera G ; Sala N ; Agudo A ; Rico F ; El Giudicce G ; Plebani M ; Palli D ; Boeing H ; Bueno de

Mesquita HB ; Carneiro F ; Berrino F ; Vineis P ; Tumino R ; Panico S ; Berglund G ; Siman H ; Nyren O ;

Hallmans G ; Martinez C ; Dorronsoro M ; Barricarte A ; Navarro C ; Quiros JR ; Allen N ; Key T ; Bingham S ; Caldas C ; Linseisen J ; Nagel G ; Overvad K ; Tjonneland A ; Boshuizen HC ; Peeters PHM ; Numans ME ; Clavel-Chapelon F ; Trichopoulou A ; Lund E ; Jenab M ; Kaaks R ; Riboli E ; Gonzalez CA

DNA repair polymorphisms and the risk of stomach adenocarcinoma and severe chronic gastritis in the EPIC-EURGAST study

Int J Epidemiol 2008; 37(6):1316-25

Crusius JBA ; Canzian F ; Capella G ; Pena AS ; Pera G ; Sala N ; Agudo A ; Rico F ; Giudice del ; Palli D ; Plebani M ; Boeing H ; Bueno de Mesquita HB ; Carneiro F ; Pala V ; Save VE ; Vineis P ; Tumino R ; Panico S ; Berglund G ; Manjer J ; Stenling R ; Hallmans G ; Martinez C ; Dorronsoro M ; Barricarte A ; Navarro C ; Quiros JR ; Allen N ; Key TJ ; Bingham S ; Caldas C ; Linseisen J ; Kaaks R ; Overvad K ; Tjonneland A ; Buchner FC ; Peeters PHM ; Numans ME ; Clavel-Chapelon F ; Trichopoulou A ; Lund E ; Jenab M ; Rinaldi S ; Ferrari P ; Riboli E ; Gonzalex CA Cytokine gene polymorphisms and the risk of adenocarcinoma of the stomach in the European Prospective Investigation into Cancer and Nutrition

(EPIC-EURGAST)

(37)

Hung RJ ; McKay JD ; Gaborieau V ; Boffetta V ; Hashibe M ; Zaridze D ; Mukeria A ; Szeszenia-Dabrowska N ; Lissowska J ; Rudnai P ; Fabianova E ; Mates D ; Bencko V ; Foretova L ; Janout V ; Chen C ; Goodman G ; Field JK ; Liloglou T ; Xinarianos G ; Cassidy A ; McLaughlin J ; Liu G ; Narod S ; Krokan HE ; Skorpen F ; Bratt Elvestad M ; Hveem K ; Vatten L ; Linseisen J ; Clavel-Chapelon F ; Vineis P ; Bueno de Mesquita HB ; Lund E ; Martinez C ; Bingham S ; Rasmuson T ; Hainaut P ; Riboli E ; Ahrens W ; Benhamou S ; Lagiou P ; Trichopoulos D ; Holcatova I ; Merletti F ; Kjaerheim K ; Agudo A ; Macfarlane G

; Talamini R ; Simonato L ; Lowry R ; Conway DI ; Znaor A ; Healy C ; Zelenika D ; Boland A ; Delepine M ; Foglio M ; Lechner D ; Matsuda F ; Blanche H ; Gut I ; Heath S ; Lathrop M ; Brennan P

A susceptibility locus for lung cancer maps to nicotinic acetylcholine receptor subunit genes on 15q25 Nature 2008; 452(7187):633-7

Jenab M ; McKay JD ; Ferrari P ; Biessy C ; Laing S ; Munar GM ; Sala N ; Crusius JB ; Overvad K ; Jensen MK ; Olsen A ; Tjonneland A ; Clavel-Chapelon F ; Boutron-Ruault MC ; Kaaks R ; Linseisen J ; Boeing H ; Bergmann MM ; Trichopoulou A ; Georgila C ;

Psaltopoulou T ; Mattiello A ; Vineis P ; Pala V ; Palli D ; Tumino R ; Numans ME ; Peeters PH ; Bueno de Mesquita HB ; Lund E ; Ardanaz E ; Sanches MJ ; Dorronsoro M ; Sanchez CN ; Quiros JR ; Hallmans G ; Stenling R ; Manjer J ; Regner S ; Key T ; Bingham S ; Khaw KT ; Slimani N ; Rinaldi S ; Boffetta P ; Carneiro F ; Riboli E ; Gonzalez C

CDH1 gene polymorphisms, smoking, Helicobacter pylori infection and the risk of gastric cancer in the European Prospective Investigation into

Cancer and Nutrition (EPIC-EURGAST) Eur J Cancer 2008; 44(6):774-80

Johansson M ; Appleby PN ; Allen NE ; Travis RC ; Roddam AW ; Egevad L ; Jenab M ; Rinaldi S ; Kiemeney LA ; Bueno de Mesquita HB ; Vollset SE ; Ueland PM ; Sanchez MJ ; Quiros JR ; Gonzalez CA ; Larranaga N ; Chirlaque MD ; Ardanaz E ; Sieri S ; Palli D ; Vineis P ; Tumino R ; Linseisen J ; Kaaks R ; Boeing H ; Pischon T ; Psaltopoulou T ; Trichopoulou A ; Trichopoulos D ; Khaw KT ; Bingham S ; Hallmans G ; Riboli E ; Stattin P ; Key TJ

Circulating concentrations of folated and vitamin B12 in relation to prostate cancer risk: results from the European prospective investigation into cancer and nutrition study

Cancer Epidemiol Biomarkers Prev 2008; 17(2):279-85

√ Kuijsten A ; Bueno de Mesquita HB ; Boer JM ; Arts IC ; Kok FJ ; Veer P van 't ; Hollman PC

Plasma enterolignans are not associated with nonfatal myocardial infarction risk Atherosclerosis 2009; 203(1):145-52

Kuijsten A ; Hollman PCH ; Boshuizen HC ; Buijsman MNCP ; Veer P van 't ; Kok FJ ; Arts ICW ; Bueno

de Mesquita HB

Plasma enterolignan concentrations and colorectal cancer risk in a nested case-control study Am J Epidemiol 2008; 167(6):734-42

McKay JD ; Hung RJ ; Gaborieau V ; Boffetta P ; Chabrier A ; Byrnes G ; Zaridze D ; Mukeria A ; Szeszenia-Dabrowska N ; Lissowska J ; Rudnai P ; Fabianova E ; Mates D ; Bencko V ; Foretova L ; Janout V ; McLaughlin J ; Shepherd F ; Montpetit A ; Narod S ; Krokan HE ; Skorpen F ; Elvestad MD ; Vatten L ; Njolstad I ; Axelsson T ; Chen C ; Goodman G ; Barnett M ; Loomis MM ; Lubiski J ; Matyjasik J ; Lener M ; Oszutowska D ; Field J ; Liloglou T ; Xinaranos G ; Cassidy A ; Zelenika D ; Boland A ; Delepine M ; Foglio M ; Lechneer D ; Matsuda F ; Blanche H ; Gut I ; Heath S ; Lathrop M ; Brennan P ; Vineis P ; Clavel-Chapelon F ; Palli D ; Tumino R ; Krogh V ; Panico S ; Gonzalez CA ; Ramon Quiros J ; Martinez C ;

(38)

Navarro C ; Ardanaz E ; Larraaga N ; Kham KT ; Key T ; Bueno de Mesquita HB ; Peeters PHM ; Trichopoulou A ; Linseisen J ; Boeing H ; Hallmans G ; Overvad K ; Tjonneland A ; Kumle M ; Riboli E Lung cancer susceptibility locus at 5p15.33

Nature Genetics 2008; 40(12):1404-6

Menvielle G ; Boshuizen H ; Kunst AE ; Dalton SO ; Vineis P ; Bergmann MM ; Hermann S ; Ferrari P ; Raaschou-Nielsen O ; Tjonneland A ; Kaaks R ; Linseisen J ; Kosti M ;

Trichopoulou A ; Dilis V ; Palli D ; Krogh V ; Panica S ; Tumino R ; Buchner FL ; Gils CH van ; Peeters PH ; Braaten T ; Gram IT ; Lund E ; Rodriguez L ; Agudo A ; Sanchez MJ ; Tormo MJ ; Ardanaz E ; Manjer J ; Wirfalt E ; Hallmans G ; Rasmuson T ; Bingham S ;

Khaw KT ; Allen N ; Key T ; Boffetta P ; Duell EJ ; Slimani N ; Gallo V ; Riboli E ; Bueno de Mesquita HB The role of smoking and diet in explaining educational inequalities in lung cancer incidence

J Nat Cancer Inst 2009; accepted

Nothlings U ; Murphy SP ; Wilkens LR ; Boeing H ; Schulze MB ; Bueno de Mesquita HB ; Michaud D ; Roddam A ; Rohrmann S ; Tjonneland A ; Clavel-Chapelon F ; Trichopoulou A ; Sieri S ; Rodriguez L ; Ye W ; Jenab M ; Kolonel LN

A food pattern that is predictive of flavonol intake and risk of pancreatic cancer Am J Clin Nutr 2008; 88(6):1653-62

Pischon T ; Boeing H ; Hoffman K ; Bergmann M ; Schulze PH ; Overvad MD ; Schouw YT van der ; Spencer E ; Moons KGM ; Tjonneland A ; Halkjaer J ; Jensen MK ; Stegger J ; Clavel-Chapelon F ; Boutron-Ruault MC ; Chajes V ; Linseisen J ; Kaaks R ; Trichopoulou A ; Trichopoulos D ; Barnia C ; Sieri S ; Palli D ; Tumino R ; Vineis P ; Panico S ; Peeters PHM ; May AM ; Bueno de Mesquita HB ; Duijnhoven FJB van ; Hallmans G ; Weinehall L ; Manjer J ; Hedblad B ; Lund E ; Agudo A ; Arriola L ; Barricarte A ; Navarro C ; Martinez C ; Quiros JR ; Key T ; Phil D ; Bingham S ; Khaw KT ; Chir B ; Boffetta P ; Jenab M ; Ferrari P ; Riboli E General and abdominal adiposty and risk of death in Europe

New England J Med 2008; 359(2):2105-20

Rinaldi S ; Rohrmann S ; Jenab M ; Biessy C ; Sieri S ; Palli D ; Tumino R ; Mattiello A ; Vineis P ; Nieters A ; Linseisen J ; Pischon T ; Boeing H ; Hallmans G ; Palmqvist R ; Manjer

J ; Wirfalt E ; Crowe FL ; Khaw KT ; Bingham S ; Tjonneland A ; Olsen A ; Overvad K ; Lund E ; Skeie G ; Clavel-Chapelon F ; Boutron-Ruault MC ; Lauzon-Guillain B de ; Ardanaz E ; Jakszyn P ; Quiros JR ; Chirlaque MD ; Sanchez MJ ; Dorronsoro M ; Trichopoulou A ; Lagiou P ; Trichopoulos D ; Bueno de

Mesquita HB ; Duijnhoven FJB van ; Peeters PHM ; Slimani N ; Ferrari P ; Byrnes GB ; Riboli E ; Kaaks R

Glycosylated hemoglobin and risk of colorectal cancer in men and women, the European prospective investigation into cancer and nutrition

Cancer Epidemiol Biomarkers Prev 2008; 17(11):3108-15

Saadatian-Elahi M ; Slimani N ; Chajes C ; Jenab M ; Goudable J ; Biessy C ; Ferrari P ; Byrnes G ; Autier P ; Peeters PHM ; Ocké M ; Bueno de Mesquita HB ; Johansson I ; Hallmans G ; Manjer J ; Wirfalt E ; Gonzalez CA ; Navarro C ; Martinez C ; Amiano P ; Rodriguez Suarez L ; Ardanaz E ; Tjonneland A ; Halkjaer J ; Overvad K ; Uhre Jakobsen M ; Berrino F ; Pala V ; Palli D ; Tumino R ; Vineis P ; Santucci de Magistris M ; Spencer EA ; Crowe FL ; Bingham S ; Khaw KT ; Linseisen J ; Rohrmann S ; Boeing H ; Noethlings U ; Standahl Olsen K ; Skeie G ; Lund E ; Trichopoulou A ; Oustoglou E ; Clavel-Chapelon F ; Riboli E

Plasma phospholipid fatty acid profiles and their association with food intakes: resulst from a cross-sectional study within the European

(39)

Am J Clin Nutr 2009; 89(1):331-46

Vrieling A ; Verhage BAJ ; Duijnhoven FJB van ; Jenab M ; Overvad K ; Tjonneland A ; Olsen A ;

Clavel-Chapelon F ; Boutron-Ruault MC ; Kaaks R ; Rohrmann S ; Boeing H ; Nothlings U ; Trichopoulou A ; John T ; Dimosthenes Z ; Palli D ; Sieri S ; Mattiello A ; Tumino R ; Vineis P ; Gils CH van ; Peeters PHM ; Engeset D ; Lund E ; Rodriguez Suarez L ; Jakszyn P ; Larranaga N ; Sanchez MJ ; Chirlaque MD ; Ardanaz E ; Manjer J ; Lindkvist B ; Hallmans G ; Ye W ; Bingham S ; Khaw KT ; Roddam A ; Key T ; Boffetta P ; Duell EJ ; Michaud DS ; Riboli E ; Bueno de Mesquita HB

Fruit and vegetable consumption and pancreatic cancer risk in the European Prospective Investigation into Cancer and Nutrition

Int J Cancer 2009; 124(8):1926-34

CIL, S/350040, Modelling health effects of nutrition

Jong N de ; Ros MM ; Ocké MC ; Verhagen H

A general postlaunch monitoring framework for functional foods tested with the phytosterol/stanol case Trends Food Sci Technol 2008; 19(10):535-45

MFF, S/370030, BIOTHREE

√ Arnal J ; Gonzalez-Alvarez I ; Bermerjo M ; Amidon GL ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ; Dressman JB ; Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Aciclovir J Pharm Sci 2008; 97(12):5061-73

√ Becker C ; Dressman JB ; Amidon GL ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ;

Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Ethambutol dihydrochloride J Pharm Sci 2008; 97(4):1350-60

√ Becker C ; Dressman JB ; Amidon GL ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ;

Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Pyrazinamide J Pharm Sci 2008; 97(9):3709-20

Becker C ; Dressman JB ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ; Barends DM Biowaiver monographs for immediate release solid oral dosage forms: Rifampicine

J Pharm Sci 2009, accepted

Benet LZ ; Amidon GL ; Barends DM ; Lennernaes H ; Polli JE ; Shah VP ; Stavchansky SA ; Yu LX The use of BDDCS in classifying the permeability of marketed drugs

Pharm Res 2008; 25(3):483-8

√ Chuasuwan B ; Binjesoh V ; Polli JE ; Zhang H ; Amidon GL ; Junginger HE ; Midha KK ; Shaw VP ; Stavchansky S ; Dressman JB ; Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Diclofenac sodium and Diclofenac potassium

(40)

√ Granero GE ; Longhi MR ; Becker C ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ; Dressman JB ; Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Acetazolamide J Pharm Sci 2008; 97(9):3691-9

√ Grube S ; Langguth P ; Junginer HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ; Dressman JB ;

Barends DM

Biowaiver monographs for immediate release solid oral dosage forms: Quinidine sulfate J Pharm Sci 2009, accepted

Stosik AG ; Junginger HE ; Kopp S ; Midha KK ; Shah VP ; Stavchansky S ; Dressman JB ; Barends DM Biowaiver monographs for immediate release solid oral dosage forms: Metoclopramide hydrochloride J Pharm Sci 2008; 97(9):3700-8

EQH, S/607001, EIA: environmental impact assessment

Brack W ; Apitz SE ; Borchard D ; Brils J ; Cardoso AC ; Foekema EM ; Gils J van ; Jansen B ; Harris M ; Hein M ; Heise S ; Hellsten S ; Maagd GJ de ; Muller D ; Panov VE ; Posthuma L ;

Quevauviller P ; Verdonschot PFM ; Ohe PC von der

Towards a holistic and risk-based management of European river basis Integr Environ Assess Manage, accepted

Hauck M ; Huijbregts MAJ ; Armitage JM ; Cousins IT ; Ragas AMJ ; Meent D van de

Model and input uncertainty in multi-media fate modelling: benzo[a]pyrene concentrations in Europe Chemosphere 2008; 72(6):959-67

Kapo KE ; Burton GA ; Zwart D de ; Posthuma L ; Dyer SD

Quantitative lines of evidence for screening-level diagnostic assessment of regional fish community impacts: a comparison of spatial database evaluation methods

Environ Sci Technol 2008: 42(24):9412-8

Mulder C ; Hollander HA den ; Hendriks AJ

Aboveground herbivory shapes the biomass distribution and flux of soil invertebrates PLoS ONE 2008; 3(10):e3573

Reuman DC ; Mulder C ; Raffaelli D ; Cohen JE

Three allometric relations of population density to body mass: theoretical integration and empirical tests in 149 food webs

Ecol Lett 2008; 11(11):1216-28

Wal A van der ; Bloem J ; Mulder C ; Boer W de

Relative abundance and activity of melanized hyphae in different soil ecosystems Soil Biol Biochem 2009; 41(2):417-9

Zelm R van ; Huijbregts MAJ ; Posthuma L ; Wintersen A ; Meent D van de

Pesticide ecotoxicological effect factors and their uncertainties for freshwater ecosystems Int J Life Cycle Assess 2009; 14(1):43-51

Afbeelding

Table 4.1 presents a breakdown of these numbers per theme.
Table 4.2 presents average impact factors and assessment scores for all research themes
Table 4.3 Other research products
Table 4.4 presents performance scores on selected societal impact indicators for all research themes
+3

Referenties

GERELATEERDE DOCUMENTEN

In Figure 1 the number of positive isolations per capsule (n=5) containing Salmonella with the addition of 10 g Salmonella negative faeces per laboratory is given after

Om een indruk te krijgen van de verdeling van de controletaak over de verschillende bedrijven en de stand van zaken van de opbouw, is het aantal bezochte installaties uitgezet

Wanneer er een onderscheid gemaakt wordt tussen leerders met een grote en met een kleine woordenschat, zijn geen verschil- len voor de mate waarin vooruitgang geboekt wordt op

Key concepts: Alcoholism, Advertisement, Anti-Alcohol Campaign, Buycot, Boycot, Consumption, Egalitarian Dogma, Fantasy, Food Politicization, Framing, Hegemonic Masculinity,

This process, called four-wave mixing, takes the pump, Stokes, and probe lasers, and combines them in such away as to provide a signal that is exactly at the anti-Stokes frequency,

The inevitable conclusion that consciousness can be experienced independently of brain function might well induce a huge change in the scientific paradigm in

It is thus important for national parks across South Africa and globally to identify their distinct park specific attributes, products and services that could

Om de rol van de media in de Griekse crisis goed te kunnen begrijpen wordt nu eerder onderzoek naar deze casus behandeld. Er is namelijk al enig onderzoek gedaan naar de media en